Trace number 3312206

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.14 1206.59

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom12.cnf
MD5SUMf0a59aeb3af8016fb8ec53aa337c4836
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark7.66183
Satisfiable
(Un)Satisfiability was proved
Number of variables17298
Number of clauses57292
Sum of the clauses size145234
Maximum clause length615
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 230583
Number of clauses of size 326391
Number of clauses of size 477
Number of clauses of size 510
Number of clauses of size over 5230

Solver Data 

0.10/0.13	33:50 INFO : Reading from input HOME/instance-3312206-1304181230.cnf
0.71/0.50	Executor set job limit to 1000000
0.71/0.50	Executor set job limit to 1000000
0.71/0.51	Executor set job limit to 1000000
0.71/0.51	Executor set job limit to 1000000
0.71/0.51	Starting Executor!
0.71/0.51	Starting Executor!
0.71/0.51	Starting Executor!
0.71/0.51	Starting Executor!
2.29/1.23	33:51 INFO : Found 3522 xor gates
4.87/2.23	33:52 INFO : 15263 variables remaining out of 17298
4.87/2.23	33:52 INFO : 475083 literals remaining out of 160262

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312206-1304181230/watcher-3312206-1304181230 -o /tmp/evaluation-result-3312206-1304181230/solver-3312206-1304181230 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312206-1304181230.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.85 8.03 8.00 5/198 5737
/proc/meminfo: memFree=30286784/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=11800 CPUtime=0 cores=0,2,4,6
/proc/5737/stat : 5737 (runsolver) S 5735 5737 5302 0 -1 4202560 43 0 0 0 0 0 0 0 25 0 1 0 529719703 12083200 51 33554432000 4194304 5434984 140737384011472 18446744073709551615 4881607 0 2147483391 4096 24578 18446744071699960631 0 0 17 2 0 0 0
/proc/5737/statm: 2950 51 31 303 0 2644 0

[startup+0.0119621 s]
/proc/loadavg: 7.85 8.03 8.00 5/198 5737
/proc/meminfo: memFree=30286784/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=8968 CPUtime=0 cores=0,2,4,6
/proc/5737/stat : 5737 (java) R 5735 5737 5302 0 -1 4194304 587 0 0 0 0 0 0 0 25 0 1 0 529719703 9183232 78 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254495740594 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/5737/statm: 2242 80 60 9 0 34 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8968

[startup+0.10498 s]
/proc/loadavg: 7.85 8.03 8.00 5/198 5737
/proc/meminfo: memFree=30286784/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15677020 CPUtime=0.1 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 5555 0 1 0 9 1 0 0 25 0 18 0 529719703 16053268480 4965 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3919255 4965 2115 9 0 3909974 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15677020

[startup+0.304948 s]
/proc/loadavg: 7.85 8.03 8.00 5/198 5737
/proc/meminfo: memFree=30286784/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15680524 CPUtime=0.51 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 14601 0 1 0 48 3 0 0 25 0 18 0 529719703 16056856576 13012 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3920131 13015 2206 9 0 3910850 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15680524

[startup+0.700874 s]
/proc/loadavg: 7.85 8.03 8.00 5/198 5737
/proc/meminfo: memFree=30286784/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15685520 CPUtime=1.16 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 45155 0 1 0 110 6 0 0 25 0 22 0 529719703 16061972480 41935 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3921380 41935 2253 9 0 3912099 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 15685520

[startup+1.50072 s]
/proc/loadavg: 7.85 8.03 8.00 7/220 5759
/proc/meminfo: memFree=30113072/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15698452 CPUtime=3.17 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 60797 0 1 0 309 8 0 0 25 0 22 0 529719703 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3924613 50063 2266 9 0 3915332 0
[pid=5737/tid=5739] ppid=5735 vsize=15698452 CPUtime=1.46 cores=0,2,4,6
/proc/5737/task/5739/stat : 5739 (java) R 5735 5737 5302 0 -1 4202560 35666 0 1 0 142 4 0 0 22 0 22 0 529719705 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505175280 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5737/tid=5740] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5740/stat : 5740 (java) S 5735 5737 5302 0 -1 4202560 33 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5741] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5741/stat : 5741 (java) S 5735 5737 5302 0 -1 4202560 341 0 0 0 0 0 0 0 18 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5742] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5742/stat : 5742 (java) S 5735 5737 5302 0 -1 4202560 44 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5743] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5743/stat : 5743 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5744] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5744/stat : 5744 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5745] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5745/stat : 5745 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5746] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5746/stat : 5746 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5747] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5747/stat : 5747 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 529719706 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5748] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5748/stat : 5748 (java) S 5735 5737 5302 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 22 0 529719707 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 0 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5749] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5749/stat : 5749 (java) S 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 529719707 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5750] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5750/stat : 5750 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 529719707 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5751] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5751/stat : 5751 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512515505 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5752] ppid=5735 vsize=15698452 CPUtime=1.07 cores=0,2,4,6
/proc/5737/task/5752/stat : 5752 (java) R 5735 5737 5302 0 -1 4202560 19171 0 0 0 105 2 0 0 25 0 22 0 529719709 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 47510284406177 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=5737/tid=5753] ppid=5735 vsize=15698452 CPUtime=0.6 cores=0,2,4,6
/proc/5737/task/5753/stat : 5753 (java) R 5735 5737 5302 0 -1 4202560 4100 0 0 0 60 0 0 0 16 0 22 0 529719709 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 47510284410958 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5737/tid=5754] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5754/stat : 5754 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5755] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5755/stat : 5755 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529719709 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5756] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5756/stat : 5756 (java) R 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 529719755 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5737/tid=5757] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5757/stat : 5757 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 529719755 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5758] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5758/stat : 5758 (java) S 5735 5737 5302 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 529719755 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5759] ppid=5735 vsize=15698452 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5759/stat : 5759 (java) S 5735 5737 5302 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 529719755 16075214848 50063 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.17
Current children cumulated vsize (KiB) 15698452

[startup+3.10641 s]
/proc/loadavg: 7.85 8.03 8.00 8/220 5759
/proc/meminfo: memFree=30095960/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15695460 CPUtime=6.18 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 70853 0 1 0 608 10 0 0 25 0 22 0 529719703 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3923865 54462 2277 9 0 3914584 0
[pid=5737/tid=5739] ppid=5735 vsize=15695460 CPUtime=2.2 cores=0,2,4,6
/proc/5737/task/5739/stat : 5739 (java) S 5735 5737 5302 0 -1 4202560 35710 0 1 0 216 4 0 0 25 0 22 0 529719705 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5740] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5740/stat : 5740 (java) S 5735 5737 5302 0 -1 4202560 33 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5741] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5741/stat : 5741 (java) S 5735 5737 5302 0 -1 4202560 341 0 0 0 0 0 0 0 15 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5742] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5742/stat : 5742 (java) S 5735 5737 5302 0 -1 4202560 44 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5743] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5743/stat : 5743 (java) S 5735 5737 5302 0 -1 4202560 1186 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5744] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5744/stat : 5744 (java) S 5735 5737 5302 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5745] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5745/stat : 5745 (java) S 5735 5737 5302 0 -1 4202560 1668 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5746] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5746/stat : 5746 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5747] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5747/stat : 5747 (java) S 5735 5737 5302 0 -1 4202560 1612 0 0 0 0 0 0 0 18 0 22 0 529719706 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5748] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5748/stat : 5748 (java) S 5735 5737 5302 0 -1 4202560 12 0 0 0 0 0 0 0 15 0 22 0 529719707 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 0 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5749] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5749/stat : 5749 (java) S 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5750] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5750/stat : 5750 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5751] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5751/stat : 5751 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512515505 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5752] ppid=5735 vsize=15695460 CPUtime=1.92 cores=0,2,4,6
/proc/5737/task/5752/stat : 5752 (java) S 5735 5737 5302 0 -1 4202560 23867 0 0 0 189 3 0 0 21 0 22 0 529719709 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5753] ppid=5735 vsize=15695460 CPUtime=1.16 cores=0,2,4,6
/proc/5737/task/5753/stat : 5753 (java) S 5735 5737 5302 0 -1 4202560 4199 0 0 0 116 0 0 0 15 0 22 0 529719709 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5754] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5754/stat : 5754 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5755] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5755/stat : 5755 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529719709 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5756] ppid=5735 vsize=15695460 CPUtime=0.04 cores=0,2,4,6
/proc/5737/task/5756/stat : 5756 (java) R 5735 5737 5302 0 -1 4202560 17 0 0 0 4 0 0 0 15 0 22 0 529719755 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912506228354 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5737/tid=5757] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5757/stat : 5757 (java) S 5735 5737 5302 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 529719755 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5758] ppid=5735 vsize=15695460 CPUtime=0.55 cores=0,2,4,6
/proc/5737/task/5758/stat : 5758 (java) R 5735 5737 5302 0 -1 4202560 8 0 0 0 55 0 0 0 15 0 22 0 529719755 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912506228667 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=5737/tid=5759] ppid=5735 vsize=15695460 CPUtime=0.22 cores=0,2,4,6
/proc/5737/task/5759/stat : 5759 (java) S 5735 5737 5302 0 -1 4202560 24 0 0 0 22 0 0 0 15 0 22 0 529719755 16072151040 54462 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 15695460

[startup+6.30071 s]
/proc/loadavg: 7.86 8.03 8.00 9/220 5759
/proc/meminfo: memFree=29938436/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15695460 CPUtime=15.52 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 146866 0 1 0 1532 20 0 0 25 0 22 0 529719703 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3923865 129338 2277 9 0 3914584 0
[pid=5737/tid=5739] ppid=5735 vsize=15695460 CPUtime=2.2 cores=0,2,4,6
/proc/5737/task/5739/stat : 5739 (java) S 5735 5737 5302 0 -1 4202560 35710 0 1 0 216 4 0 0 25 0 22 0 529719705 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5740] ppid=5735 vsize=15695460 CPUtime=0.02 cores=0,2,4,6
/proc/5737/task/5740/stat : 5740 (java) S 5735 5737 5302 0 -1 4202560 4703 0 0 0 2 0 0 0 15 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5741] ppid=5735 vsize=15695460 CPUtime=0.06 cores=0,2,4,6
/proc/5737/task/5741/stat : 5741 (java) S 5735 5737 5302 0 -1 4202560 9487 0 0 0 6 0 0 0 16 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5742] ppid=5735 vsize=15695460 CPUtime=0.03 cores=0,2,4,6
/proc/5737/task/5742/stat : 5742 (java) S 5735 5737 5302 0 -1 4202560 4660 0 0 0 3 0 0 0 15 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5743] ppid=5735 vsize=15695460 CPUtime=0.05 cores=0,2,4,6
/proc/5737/task/5743/stat : 5743 (java) S 5735 5737 5302 0 -1 4202560 13807 0 0 0 3 2 0 0 16 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5744] ppid=5735 vsize=15695460 CPUtime=0.04 cores=0,2,4,6
/proc/5737/task/5744/stat : 5744 (java) S 5735 5737 5302 0 -1 4202560 6334 0 0 0 4 0 0 0 15 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5745] ppid=5735 vsize=15695460 CPUtime=0.05 cores=0,2,4,6
/proc/5737/task/5745/stat : 5745 (java) S 5735 5737 5302 0 -1 4202560 7486 0 0 0 5 0 0 0 15 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5746] ppid=5735 vsize=15695460 CPUtime=0.03 cores=0,2,4,6
/proc/5737/task/5746/stat : 5746 (java) S 5735 5737 5302 0 -1 4202560 5941 0 0 0 3 0 0 0 15 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5747] ppid=5735 vsize=15695460 CPUtime=0.06 cores=0,2,4,6
/proc/5737/task/5747/stat : 5747 (java) S 5735 5737 5302 0 -1 4202560 9987 0 0 0 5 1 0 0 15 0 22 0 529719706 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5748] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5748/stat : 5748 (java) S 5735 5737 5302 0 -1 4202560 264 0 0 0 0 0 0 0 15 0 22 0 529719707 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 0 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5749] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5749/stat : 5749 (java) S 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5750] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5750/stat : 5750 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5751] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5751/stat : 5751 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512515505 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5752] ppid=5735 vsize=15695460 CPUtime=1.96 cores=0,2,4,6
/proc/5737/task/5752/stat : 5752 (java) S 5735 5737 5302 0 -1 4202560 23871 0 0 0 193 3 0 0 15 0 22 0 529719709 16072151040 129338 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=5737/tid=5757] ppid=5735 vsize=15695460 CPUtime=1105.91 cores=0,2,4,6
/proc/5737/task/5757/stat : 5757 (java) R 5735 5737 5302 0 -1 4202560 322465 0 0 0 110553 38 0 0 25 0 22 0 529719755 16072151040 356031 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912506066036 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5737/tid=5758] ppid=5735 vsize=15695460 CPUtime=1106.53 cores=0,2,4,6
/proc/5737/task/5758/stat : 5758 (java) R 5735 5737 5302 0 -1 4202560 314538 0 0 0 110616 37 0 0 25 0 22 0 529719755 16072151040 356031 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955444 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5737/tid=5759] ppid=5735 vsize=15695460 CPUtime=1106.47 cores=0,2,4,6
/proc/5737/task/5759/stat : 5759 (java) R 5735 5737 5302 0 -1 4202560 356639 0 0 0 110603 44 0 0 25 0 22 0 529719755 16072151040 356031 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955420 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4464.28
Current children cumulated vsize (KiB) 15695460

[startup+1182.3 s]
/proc/loadavg: 8.24 8.07 7.92 9/220 5842
/proc/meminfo: memFree=20258536/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15695460 CPUtime=4703.57 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 3543994 0 1 0 469778 579 0 0 25 0 22 0 529719703 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3923865 346489 2295 9 0 3914584 0
[pid=5737/tid=5739] ppid=5735 vsize=15695460 CPUtime=2.2 cores=0,2,4,6
/proc/5737/task/5739/stat : 5739 (java) S 5735 5737 5302 0 -1 4202560 35710 0 1 0 216 4 0 0 25 0 22 0 529719705 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5740] ppid=5735 vsize=15695460 CPUtime=4.08 cores=0,2,4,6
/proc/5737/task/5740/stat : 5740 (java) S 5735 5737 5302 0 -1 4202560 231906 0 0 0 370 38 0 0 15 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5741] ppid=5735 vsize=15695460 CPUtime=4.54 cores=0,2,4,6
/proc/5737/task/5741/stat : 5741 (java) S 5735 5737 5302 0 -1 4202560 268880 0 0 0 409 45 0 0 16 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5742] ppid=5735 vsize=15695460 CPUtime=4.31 cores=0,2,4,6
/proc/5737/task/5742/stat : 5742 (java) S 5735 5737 5302 0 -1 4202560 273836 0 0 0 389 42 0 0 16 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5743] ppid=5735 vsize=15695460 CPUtime=4.29 cores=0,2,4,6
/proc/5737/task/5743/stat : 5743 (java) S 5735 5737 5302 0 -1 4202560 271031 0 0 0 385 44 0 0 15 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5744] ppid=5735 vsize=15695460 CPUtime=4.53 cores=0,2,4,6
/proc/5737/task/5744/stat : 5744 (java) S 5735 5737 5302 0 -1 4202560 272779 0 0 0 410 43 0 0 15 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5745] ppid=5735 vsize=15695460 CPUtime=4.19 cores=0,2,4,6
/proc/5737/task/5745/stat : 5745 (java) S 5735 5737 5302 0 -1 4202560 249206 0 0 0 377 42 0 0 16 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5746] ppid=5735 vsize=15695460 CPUtime=4.25 cores=0,2,4,6
/proc/5737/task/5746/stat : 5746 (java) S 5735 5737 5302 0 -1 4202560 243936 0 0 0 384 41 0 0 15 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5747] ppid=5735 vsize=15695460 CPUtime=4.52 cores=0,2,4,6
/proc/5737/task/5747/stat : 5747 (java) S 5735 5737 5302 0 -1 4202560 270300 0 0 0 409 43 0 0 16 0 22 0 529719706 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5748] ppid=5735 vsize=15695460 CPUtime=2.43 cores=0,2,4,6
/proc/5737/task/5748/stat : 5748 (java) S 5735 5737 5302 0 -1 4202560 9026 0 0 0 183 60 0 0 15 0 22 0 529719707 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 0 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5749] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5749/stat : 5749 (java) S 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5750] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5750/stat : 5750 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5751] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5751/stat : 5751 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512515505 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5752] ppid=5735 vsize=15695460 CPUtime=2.29 cores=0,2,4,6
/proc/5737/task/5752/stat : 5752 (java) S 5735 5737 5302 0 -1 4202560 23911 0 0 0 226 3 0 0 16 0 22 0 529719709 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5753] ppid=5735 vsize=15695460 CPUtime=1.57 cores=0,2,4,6
/proc/5737/task/5753/stat : 5753 (java) S 5735 5737 5302 0 -1 4202560 4256 0 0 0 157 0 0 0 15 0 22 0 529719709 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5754] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5754/stat : 5754 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5755] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5755/stat : 5755 (java) S 5735 5737 5302 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 529719709 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5756] ppid=5735 vsize=15695460 CPUtime=1163.33 cores=0,2,4,6
/proc/5737/task/5756/stat : 5756 (java) R 5735 5737 5302 0 -1 4202560 354736 0 0 0 116290 43 0 0 25 0 22 0 529719755 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955296 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5737/tid=5757] ppid=5735 vsize=15695460 CPUtime=1165.34 cores=0,2,4,6
/proc/5737/task/5757/stat : 5757 (java) R 5735 5737 5302 0 -1 4202560 333841 0 0 0 116495 39 0 0 25 0 22 0 529719755 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955187 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5737/tid=5758] ppid=5735 vsize=15695460 CPUtime=1165.64 cores=0,2,4,6
/proc/5737/task/5758/stat : 5758 (java) R 5735 5737 5302 0 -1 4202560 326301 0 0 0 116526 38 0 0 25 0 22 0 529719755 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505989798 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5737/tid=5759] ppid=5735 vsize=15695460 CPUtime=1165.91 cores=0,2,4,6
/proc/5737/task/5759/stat : 5759 (java) R 5735 5737 5302 0 -1 4202560 372886 0 0 0 116546 45 0 0 25 0 22 0 529719755 16072151040 346489 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505911402 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4703.57
Current children cumulated vsize (KiB) 15695460



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.5 s]
/proc/loadavg: 8.15 8.06 7.92 9/220 5842
/proc/meminfo: memFree=19820296/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15695460 CPUtime=4800.02 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 3680297 0 1 0 479403 599 0 0 25 0 22 0 529719703 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3923865 442572 2295 9 0 3914584 0
[pid=5737/tid=5739] ppid=5735 vsize=15695460 CPUtime=2.2 cores=0,2,4,6
/proc/5737/task/5739/stat : 5739 (java) S 5735 5737 5302 0 -1 4202560 35710 0 1 0 216 4 0 0 25 0 22 0 529719705 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5740] ppid=5735 vsize=15695460 CPUtime=4.15 cores=0,2,4,6
/proc/5737/task/5740/stat : 5740 (java) S 5735 5737 5302 0 -1 4202560 235287 0 0 0 376 39 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5741] ppid=5735 vsize=15695460 CPUtime=4.64 cores=0,2,4,6
/proc/5737/task/5741/stat : 5741 (java) S 5735 5737 5302 0 -1 4202560 281733 0 0 0 417 47 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5742] ppid=5735 vsize=15695460 CPUtime=4.4 cores=0,2,4,6
/proc/5737/task/5742/stat : 5742 (java) S 5735 5737 5302 0 -1 4202560 280785 0 0 0 397 43 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5743] ppid=5735 vsize=15695460 CPUtime=4.38 cores=0,2,4,6
/proc/5737/task/5743/stat : 5743 (java) S 5735 5737 5302 0 -1 4202560 284639 0 0 0 392 46 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5744] ppid=5735 vsize=15695460 CPUtime=4.6 cores=0,2,4,6
/proc/5737/task/5744/stat : 5744 (java) S 5735 5737 5302 0 -1 4202560 281152 0 0 0 416 44 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5745] ppid=5735 vsize=15695460 CPUtime=4.25 cores=0,2,4,6
/proc/5737/task/5745/stat : 5745 (java) S 5735 5737 5302 0 -1 4202560 252548 0 0 0 382 43 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5746] ppid=5735 vsize=15695460 CPUtime=4.35 cores=0,2,4,6
/proc/5737/task/5746/stat : 5746 (java) S 5735 5737 5302 0 -1 4202560 255883 0 0 0 391 44 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5747] ppid=5735 vsize=15695460 CPUtime=4.6 cores=0,2,4,6
/proc/5737/task/5747/stat : 5747 (java) S 5735 5737 5302 0 -1 4202560 278968 0 0 0 416 44 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5748] ppid=5735 vsize=15695460 CPUtime=2.5 cores=0,2,4,6
/proc/5737/task/5748/stat : 5748 (java) S 5735 5737 5302 0 -1 4202560 9301 0 0 0 189 61 0 0 15 0 22 0 529719707 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 0 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5749] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5749/stat : 5749 (java) S 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5750] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5750/stat : 5750 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5751] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5751/stat : 5751 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512515505 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5752] ppid=5735 vsize=15695460 CPUtime=2.29 cores=0,2,4,6
/proc/5737/task/5752/stat : 5752 (java) S 5735 5737 5302 0 -1 4202560 23911 0 0 0 226 3 0 0 16 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5753] ppid=5735 vsize=15695460 CPUtime=1.57 cores=0,2,4,6
/proc/5737/task/5753/stat : 5753 (java) S 5735 5737 5302 0 -1 4202560 4256 0 0 0 157 0 0 0 15 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5754] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5754/stat : 5754 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5755] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5755/stat : 5755 (java) S 5735 5737 5302 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5756] ppid=5735 vsize=15695460 CPUtime=1187.29 cores=0,2,4,6
/proc/5737/task/5756/stat : 5756 (java) R 5735 5737 5302 0 -1 4202560 375044 0 0 0 118684 45 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955288 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5737/tid=5757] ppid=5735 vsize=15695460 CPUtime=1189.3 cores=0,2,4,6
/proc/5737/task/5757/stat : 5757 (java) R 5735 5737 5302 0 -1 4202560 346068 0 0 0 118889 41 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955356 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5737/tid=5758] ppid=5735 vsize=15695460 CPUtime=1189.47 cores=0,2,4,6
/proc/5737/task/5758/stat : 5758 (java) R 5735 5737 5302 0 -1 4202560 342165 0 0 0 118908 39 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955175 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5737/tid=5759] ppid=5735 vsize=15695460 CPUtime=1189.86 cores=0,2,4,6
/proc/5737/task/5759/stat : 5759 (java) R 5735 5737 5302 0 -1 4202560 391394 0 0 0 118939 47 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912506473661 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.02
Current children cumulated vsize (KiB) 15695460

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.5 s]
/proc/loadavg: 8.15 8.06 7.92 9/220 5842
/proc/meminfo: memFree=19820296/32950928 swapFree=67111464/67111528
[pid=5737] ppid=5735 vsize=15695460 CPUtime=4800.02 cores=0,2,4,6
/proc/5737/stat : 5737 (java) S 5735 5737 5302 0 -1 4202496 3680297 0 1 0 479403 599 0 0 25 0 22 0 529719703 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/5737/statm: 3923865 442572 2295 9 0 3914584 0
[pid=5737/tid=5739] ppid=5735 vsize=15695460 CPUtime=2.2 cores=0,2,4,6
/proc/5737/task/5739/stat : 5739 (java) S 5735 5737 5302 0 -1 4202560 35710 0 1 0 216 4 0 0 25 0 22 0 529719705 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5740] ppid=5735 vsize=15695460 CPUtime=4.15 cores=0,2,4,6
/proc/5737/task/5740/stat : 5740 (java) S 5735 5737 5302 0 -1 4202560 235287 0 0 0 376 39 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5741] ppid=5735 vsize=15695460 CPUtime=4.64 cores=0,2,4,6
/proc/5737/task/5741/stat : 5741 (java) S 5735 5737 5302 0 -1 4202560 281733 0 0 0 417 47 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5742] ppid=5735 vsize=15695460 CPUtime=4.4 cores=0,2,4,6
/proc/5737/task/5742/stat : 5742 (java) S 5735 5737 5302 0 -1 4202560 280785 0 0 0 397 43 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5743] ppid=5735 vsize=15695460 CPUtime=4.38 cores=0,2,4,6
/proc/5737/task/5743/stat : 5743 (java) S 5735 5737 5302 0 -1 4202560 284639 0 0 0 392 46 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5744] ppid=5735 vsize=15695460 CPUtime=4.6 cores=0,2,4,6
/proc/5737/task/5744/stat : 5744 (java) S 5735 5737 5302 0 -1 4202560 281152 0 0 0 416 44 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5745] ppid=5735 vsize=15695460 CPUtime=4.25 cores=0,2,4,6
/proc/5737/task/5745/stat : 5745 (java) S 5735 5737 5302 0 -1 4202560 252548 0 0 0 382 43 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5746] ppid=5735 vsize=15695460 CPUtime=4.35 cores=0,2,4,6
/proc/5737/task/5746/stat : 5746 (java) S 5735 5737 5302 0 -1 4202560 255883 0 0 0 391 44 0 0 15 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5747] ppid=5735 vsize=15695460 CPUtime=4.6 cores=0,2,4,6
/proc/5737/task/5747/stat : 5747 (java) S 5735 5737 5302 0 -1 4202560 278968 0 0 0 416 44 0 0 16 0 22 0 529719706 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 4 0 0 0
[pid=5737/tid=5748] ppid=5735 vsize=15695460 CPUtime=2.5 cores=0,2,4,6
/proc/5737/task/5748/stat : 5748 (java) S 5735 5737 5302 0 -1 4202560 9301 0 0 0 189 61 0 0 15 0 22 0 529719707 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 0 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5749] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5749/stat : 5749 (java) S 5735 5737 5302 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5750] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5750/stat : 5750 (java) S 5735 5737 5302 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529719707 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5751] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5751/stat : 5751 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512515505 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5752] ppid=5735 vsize=15695460 CPUtime=2.29 cores=0,2,4,6
/proc/5737/task/5752/stat : 5752 (java) S 5735 5737 5302 0 -1 4202560 23911 0 0 0 226 3 0 0 16 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5753] ppid=5735 vsize=15695460 CPUtime=1.57 cores=0,2,4,6
/proc/5737/task/5753/stat : 5753 (java) S 5735 5737 5302 0 -1 4202560 4256 0 0 0 157 0 0 0 15 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 2 0 0 0
[pid=5737/tid=5754] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5754/stat : 5754 (java) S 5735 5737 5302 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512507801 0 4 0 16800975 18446604441456239552 0 0 -1 6 0 0 0
[pid=5737/tid=5755] ppid=5735 vsize=15695460 CPUtime=0 cores=0,2,4,6
/proc/5737/task/5755/stat : 5755 (java) S 5735 5737 5302 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 529719709 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 254512508416 0 4 0 16800975 18446604441456239552 0 0 -1 0 0 0 0
[pid=5737/tid=5756] ppid=5735 vsize=15695460 CPUtime=1187.29 cores=0,2,4,6
/proc/5737/task/5756/stat : 5756 (java) R 5735 5737 5302 0 -1 4202560 375044 0 0 0 118684 45 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955288 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5737/tid=5757] ppid=5735 vsize=15695460 CPUtime=1189.3 cores=0,2,4,6
/proc/5737/task/5757/stat : 5757 (java) R 5735 5737 5302 0 -1 4202560 346068 0 0 0 118889 41 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955356 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5737/tid=5758] ppid=5735 vsize=15695460 CPUtime=1189.47 cores=0,2,4,6
/proc/5737/task/5758/stat : 5758 (java) R 5735 5737 5302 0 -1 4202560 342165 0 0 0 118908 39 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912505955175 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5737/tid=5759] ppid=5735 vsize=15695460 CPUtime=1189.86 cores=0,2,4,6
/proc/5737/task/5759/stat : 5759 (java) R 5735 5737 5302 0 -1 4202560 391394 0 0 0 118939 47 0 0 25 0 22 0 529719755 16072151040 442572 33554432000 1073741824 1073778376 140736212016160 18446744073709551615 46912506473661 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.02
Current children cumulated vsize (KiB) 15695460

Child status: 143
Real time (s): 1206.59
CPU time (s): 4800.14
CPU user time (s): 4794.07
CPU system time (s): 6.07608
CPU usage (%): 397.826
Max. virtual memory (cumulated for all children) (KiB): 15698464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.07
system time used= 6.07608
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3680323
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 50652
involuntary context switches= 61839

runsolver used 1.9627 second user time and 4.68729 second system time

The end

Launcher Data 

Begin job on node149 at 2011-04-30 18:33:50
IDJOB=3312206
IDBENCH=83118
IDSOLVER=1698
FILE ID=node149/3312206-1304181230
RUNJOBID= node149-1304178811-5320
PBS_JOBID= 13172449
Free space on /tmp= 73324 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom12.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312206-1304181230/watcher-3312206-1304181230 -o /tmp/evaluation-result-3312206-1304181230/solver-3312206-1304181230 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312206-1304181230.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f0a59aeb3af8016fb8ec53aa337c4836
RANDOM SEED=2046605792

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30287056 kB
Buffers:        515896 kB
Cached:        1409828 kB
SwapCached:         60 kB
Active:         479524 kB
Inactive:      1806876 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30287056 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            2788 kB
Writeback:           0 kB
AnonPages:      360512 kB
Mapped:          23480 kB
Slab:           312272 kB
PageTables:       6484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   558192 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73316 MiB
End job on node149 at 2011-04-30 18:53:59