Trace number 3311171

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 2192.17 1302.52

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v30000-c126000-S1196935200-064-UNKNOWN.cnf
MD5SUMa5ac359cd8af4f1e83d886effb49a2a9
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark204.405
Satisfiable
(Un)Satisfiability was proved
Number of variables30000
Number of clauses126000
Sum of the clauses size378000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3126000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	33:38 INFO : Reading from input HOME/instance-3311171-1304112817.cnf
0.92/0.75	Executor set job limit to 1000000
0.92/0.76	Executor set job limit to 1000000
0.92/0.76	Executor set job limit to 1000000
0.92/0.76	Executor set job limit to 1000000
0.92/0.76	Starting Executor!
0.92/0.76	Starting Executor!
0.92/0.76	Starting Executor!
0.92/0.76	Starting Executor!
3.58/2.18	33:40 INFO : 29897 variables remaining out of 30000
3.58/2.18	33:40 INFO : 501536 literals remaining out of 504000
1196.05/329.07	39:05 ERROR: Failed to solve instance
1196.05/329.07	java.lang.OutOfMemoryError: Java heap space
1196.05/329.07		at ibis.structure.HyperBinaryResolution.<init>(HyperBinaryResolution.java:51)
1196.05/329.07		at ibis.structure.Solver.simplify(Solver.java:191)
1196.05/329.07		at ibis.structure.Solver.solve(Solver.java:113)
1196.05/329.07		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1196.05/329.07		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1196.05/329.07		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1196.05/329.07		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1196.05/329.07		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1196.05/329.07		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1196.05/329.07		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1196.05/329.07		at ibis.constellation.Executor.processActivities(Executor.java:75)
1196.05/329.07		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1196.05/329.07		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1196.05/329.07		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1200.90/333.84	39:11 ERROR: Failed to solve instance
1200.90/333.84	java.lang.OutOfMemoryError: Java heap space
1200.90/333.84		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:222)
1200.90/333.84		at gnu.trove.THash.postInsertHook(THash.java:370)
1200.90/333.84		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1200.90/333.84		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1200.90/333.84		at ibis.structure.Subsumming.run(Subsumming.java:58)
1200.90/333.84		at ibis.structure.Solver.simplify(Solver.java:205)
1200.90/333.84		at ibis.structure.Solver.solve(Solver.java:113)
1200.90/333.84		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1200.90/333.84		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1200.90/333.84		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1200.90/333.84		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1200.90/333.84		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1200.90/333.84		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1200.90/333.84		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1200.90/333.84		at ibis.constellation.Executor.processActivities(Executor.java:75)
1200.90/333.84		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1200.90/333.84		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1200.90/333.84		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1225.96/358.52	39:35 ERROR: Failed to solve instance
1225.96/358.52	java.lang.OutOfMemoryError: Java heap space
1225.96/358.52		at ibis.structure.HyperBinaryResolution.run(HyperBinaryResolution.java:74)
1225.96/358.52		at ibis.structure.Solver.simplify(Solver.java:191)
1225.96/358.52		at ibis.structure.Solver.solve(Solver.java:113)
1225.96/358.52		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1225.96/358.52		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1225.96/358.52		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1225.96/358.52		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1225.96/358.52		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1225.96/358.52		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1225.96/358.52		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1225.96/358.52		at ibis.constellation.Executor.processActivities(Executor.java:75)
1225.96/358.52		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1225.96/358.52		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1225.96/358.52		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1229.27/361.75	39:39 ERROR: Failed to solve instance
1229.27/361.75	java.lang.OutOfMemoryError: Java heap space
1229.27/361.75		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
1229.27/361.75		at gnu.trove.THash.postInsertHook(THash.java:370)
1229.27/361.75		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1229.27/361.75		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1229.27/361.75		at ibis.structure.Subsumming.run(Subsumming.java:58)
1229.27/361.75		at ibis.structure.Solver.simplify(Solver.java:205)
1229.27/361.75		at ibis.structure.Solver.solve(Solver.java:113)
1229.27/361.75		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1229.27/361.75		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1229.27/361.75		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1229.27/361.75		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1229.27/361.75		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1229.27/361.75		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1229.27/361.75		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1229.27/361.75		at ibis.constellation.Executor.processActivities(Executor.java:75)
1229.27/361.75		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1229.27/361.75		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1229.27/361.75		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1237.27/369.23	39:47 ERROR: Failed to solve instance
1237.27/369.23	java.lang.OutOfMemoryError: Java heap space
1238.97/370.90	39:48 ERROR: Failed to solve instance
1238.97/370.90	java.lang.OutOfMemoryError: Java heap space
1318.72/449.25	41:07 ERROR: Failed to solve instance
1318.72/449.25	java.lang.OutOfMemoryError: Java heap space
1577.03/707.45	45:25 ERROR: Failed to solve instance
1577.03/707.45	java.lang.OutOfMemoryError: Java heap space
1593.27/723.65	45:32 ERROR: Failed to solve instance
1593.27/723.65	java.lang.OutOfMemoryError: Java heap space
1615.01/745.26	45:56 ERROR: Failed to solve instance
1615.01/745.26	java.lang.OutOfMemoryError: Java heap space
1618.79/748.98	46:07 ERROR: Failed to solve instance
1618.79/748.98	java.lang.OutOfMemoryError: Java heap space
1640.74/770.75	46:28 ERROR: Failed to solve instance
1640.74/770.75	java.lang.OutOfMemoryError: Java heap space
1643.96/773.89	46:31 ERROR: Failed to solve instance
1643.96/773.89	java.lang.OutOfMemoryError: Java heap space
1647.55/777.17	46:35 ERROR: Failed to solve instance
1647.55/777.17	java.lang.OutOfMemoryError: Java heap space
1650.47/779.88	46:37 ERROR: Failed to solve instance
1650.47/779.88	java.lang.OutOfMemoryError: Java heap space
1658.44/786.33	46:44 ERROR: Failed to solve instance
1658.44/786.33	java.lang.OutOfMemoryError: Java heap space
1661.71/789.43	46:47 ERROR: Failed to solve instance
1661.71/789.43	java.lang.OutOfMemoryError: Java heap space
1683.86/811.45	47:09 ERROR: Failed to solve instance
1683.86/811.45	java.lang.OutOfMemoryError: Java heap space
1685.10/812.63	47:10 ERROR: Failed to solve instance
1685.10/812.63	java.lang.OutOfMemoryError: Java heap space
1707.52/834.84	47:32 ERROR: Failed to solve instance
1707.52/834.84	java.lang.OutOfMemoryError: Java heap space
1707.52/834.84	47:32 ERROR: Failed to solve instance
1707.52/834.84	java.lang.OutOfMemoryError: Java heap space
1710.34/837.22	47:35 ERROR: Failed to solve instance
1710.34/837.22	java.lang.OutOfMemoryError: Java heap space
1718.20/843.88	47:41 ERROR: Failed to solve instance
1718.20/843.88	java.lang.OutOfMemoryError: Java heap space
1726.86/852.02	47:49 ERROR: Failed to solve instance
1726.86/852.02	java.lang.OutOfMemoryError: Java heap space
1752.49/877.46	48:15 ERROR: Failed to solve instance
1752.49/877.46	java.lang.OutOfMemoryError: Java heap space
1759.52/884.05	48:22 ERROR: Failed to solve instance
1759.52/884.05	java.lang.OutOfMemoryError: Java heap space
1760.98/885.46	48:23 ERROR: Failed to solve instance
1760.98/885.46	java.lang.OutOfMemoryError: Java heap space
1762.82/887.03	48:25 ERROR: Failed to solve instance
1762.82/887.03	java.lang.OutOfMemoryError: Java heap space
1766.13/889.96	48:28 ERROR: Failed to solve instance
1766.13/889.96	java.lang.OutOfMemoryError: Java heap space
1770.67/893.90	48:31 ERROR: Failed to solve instance
1770.67/893.90	java.lang.OutOfMemoryError: Java heap space
1775.99/898.79	48:36 ERROR: Failed to solve instance
1775.99/898.79	java.lang.OutOfMemoryError: Java heap space
1782.37/904.58	48:42 ERROR: Failed to solve instance
1782.37/904.58	java.lang.OutOfMemoryError: Java heap space
1786.92/908.67	48:46 ERROR: Failed to solve instance
1786.92/908.67	java.lang.OutOfMemoryError: Java heap space
1809.02/930.45	49:08 ERROR: Failed to solve instance
1809.02/930.45	java.lang.OutOfMemoryError: Java heap space
1822.78/943.86	49:21 ERROR: Failed to solve instance
1822.78/943.86	java.lang.OutOfMemoryError: Java heap space
1824.90/945.89	49:23 ERROR: Failed to solve instance
1824.90/945.89	java.lang.OutOfMemoryError: Java heap space
1828.65/949.49	49:27 ERROR: Failed to solve instance
1828.65/949.49	java.lang.OutOfMemoryError: Java heap space
1832.96/953.43	49:31 ERROR: Failed to solve instance
1832.96/953.43	java.lang.OutOfMemoryError: Java heap space
1857.02/976.47	49:54 ERROR: Failed to solve instance
1857.02/976.47	java.lang.OutOfMemoryError: Java heap space
1858.87/978.26	49:56 ERROR: Failed to solve instance
1858.87/978.26	java.lang.OutOfMemoryError: Java heap space
1911.92/1030.89	50:48 ERROR: Failed to solve instance
1911.92/1030.89	java.lang.OutOfMemoryError: Java heap space
1912.22/1031.10	50:49 ERROR: Failed to solve instance
1912.22/1031.10	java.lang.OutOfMemoryError: Java heap space
1942.07/1060.99	51:18 ERROR: Failed to solve instance
1942.07/1060.99	java.lang.OutOfMemoryError: Java heap space
1942.48/1061.39	51:18 ERROR: Failed to solve instance
1942.48/1061.39	java.lang.OutOfMemoryError: Java heap space
1947.38/1065.64	51:23 ERROR: Failed to solve instance
1947.38/1065.64	java.lang.OutOfMemoryError: Java heap space
1974.07/1091.59	51:49 ERROR: Failed to solve instance
1974.07/1091.59	java.lang.OutOfMemoryError: Java heap space
1977.83/1094.97	51:53 ERROR: Failed to solve instance
1977.83/1094.97	java.lang.OutOfMemoryError: Java heap space
1999.39/1116.37	52:14 ERROR: Failed to solve instance
1999.39/1116.37	java.lang.OutOfMemoryError: Java heap space
2003.01/1119.41	52:17 ERROR: Failed to solve instance
2003.01/1119.41	java.lang.OutOfMemoryError: Java heap space
2028.97/1144.26	52:42 ERROR: Failed to solve instance
2028.97/1144.26	java.lang.OutOfMemoryError: Java heap space
2041.82/1156.53	52:54 ERROR: Failed to solve instance
2041.82/1156.53	java.lang.OutOfMemoryError: Java heap space
2044.87/1159.50	52:57 ERROR: Failed to solve instance
2044.87/1159.50	java.lang.OutOfMemoryError: Java heap space
2047.42/1161.80	52:59 ERROR: Failed to solve instance
2047.42/1161.80	java.lang.OutOfMemoryError: Java heap space
2050.70/1165.00	53:02 ERROR: Failed to solve instance
2050.70/1165.00	java.lang.OutOfMemoryError: Java heap space
2054.27/1168.36	53:06 ERROR: Failed to solve instance
2054.27/1168.36	java.lang.OutOfMemoryError: Java heap space
2068.44/1181.42	53:19 ERROR: Failed to solve instance
2068.44/1181.42	java.lang.OutOfMemoryError: Java heap space
2071.10/1183.98	53:22 ERROR: Failed to solve instance
2071.10/1183.98	java.lang.OutOfMemoryError: Java heap space
2074.70/1187.49	53:25 ERROR: Failed to solve instance
2074.70/1187.49	java.lang.OutOfMemoryError: Java heap space
2078.72/1191.32	53:29 ERROR: Failed to solve instance
2078.72/1191.32	java.lang.OutOfMemoryError: Java heap space
2100.69/1213.13	53:51 ERROR: Failed to solve instance
2100.69/1213.13	java.lang.OutOfMemoryError: Java heap space
2131.00/1243.29	54:20 ERROR: Failed to solve instance
2131.00/1243.29	java.lang.OutOfMemoryError: Java heap space
2131.00/1243.29	54:21 ERROR: Failed to solve instance
2131.00/1243.29	java.lang.OutOfMemoryError: Java heap space
2139.69/1250.29	54:28 ERROR: Failed to solve instance
2139.69/1250.29	java.lang.OutOfMemoryError: Java heap space

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311171-1304112817/watcher-3311171-1304112817 -o /tmp/evaluation-result-3311171-1304112817/solver-3311171-1304112817 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311171-1304112817.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.92 7.86 7.85 2/194 25601
/proc/meminfo: memFree=31104300/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=27172 CPUtime=0 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 1423 0 0 0 0 0 0 0 21 0 2 0 503698015 27824128 893 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 7096 895 685 9 0 381 0
[pid=25601/tid=25602] ppid=25599 vsize=28384 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) R 25599 25601 24746 0 -1 4202560 71 0 0 0 0 0 0 0 22 0 2 0 503698015 29065216 897 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212034731655 0 0 4096 0 0 0 0 -1 5 0 0 0

[startup+0.0528969 s]
/proc/loadavg: 6.92 7.86 7.85 2/194 25601
/proc/meminfo: memFree=31104300/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15609648 CPUtime=0.04 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 4104 0 1 0 4 0 0 0 21 0 18 0 503698015 15984279552 3543 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3902412 3543 1754 9 0 3893131 0
[pid=25601/tid=25602] ppid=25599 vsize=15609648 CPUtime=0.03 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) R 25599 25601 24746 0 -1 4202560 2687 0 1 0 3 0 0 0 25 0 18 0 503698015 15984279552 3543 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051482059 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 15609648

[startup+0.100889 s]
/proc/loadavg: 6.92 7.86 7.85 2/194 25601
/proc/meminfo: memFree=31104300/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15741888 CPUtime=0.1 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 5616 0 1 0 10 0 0 0 21 0 18 0 503698015 16119693312 5035 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3935472 5036 2117 9 0 3926191 0
[pid=25601/tid=25602] ppid=25599 vsize=15741888 CPUtime=0.08 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) R 25599 25601 24746 0 -1 4202560 3469 0 1 0 8 0 0 0 25 0 18 0 503698015 16119693312 5036 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46922885173155 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15741888

[startup+0.300866 s]
/proc/loadavg: 6.92 7.86 7.85 2/194 25601
/proc/meminfo: memFree=31104300/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15745008 CPUtime=0.51 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 15998 0 1 0 49 2 0 0 21 0 18 0 503698015 16122888192 14455 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3936252 14461 2206 9 0 3926971 0
[pid=25601/tid=25602] ppid=25599 vsize=15745008 CPUtime=0.28 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) R 25599 25601 24746 0 -1 4202560 10883 0 1 0 27 1 0 0 25 0 18 0 503698015 16122888192 14464 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46912505365719 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15745008

[startup+0.700781 s]
/proc/loadavg: 6.92 7.86 7.85 2/194 25601
/proc/meminfo: memFree=31104300/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15745008 CPUtime=0.92 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 41827 0 1 0 86 6 0 0 21 0 18 0 503698015 16122888192 40282 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3936252 40282 2222 9 0 3926971 0
[pid=25601/tid=25602] ppid=25599 vsize=15745008 CPUtime=0.67 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) R 25599 25601 24746 0 -1 4202560 35528 0 1 0 62 5 0 0 25 0 18 0 503698015 16122888192 40282 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46912505565814 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 15745008

[startup+1.50164 s]
/proc/loadavg: 6.92 7.86 7.85 7/220 25627
/proc/meminfo: memFree=30808664/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15780420 CPUtime=2.45 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 56700 0 1 0 237 8 0 0 21 0 22 0 503698015 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3945105 51088 2264 9 0 3935824 0
[pid=25601/tid=25602] ppid=25599 vsize=15780420 CPUtime=1.46 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) R 25599 25601 24746 0 -1 4202560 35655 0 1 0 141 5 0 0 25 0 22 0 503698015 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46922885161936 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25601/tid=25604] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25604/stat : 25604 (java) S 25599 25601 24746 0 -1 4202560 1027 0 0 0 0 0 0 0 17 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25605] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25605/stat : 25605 (java) S 25599 25601 24746 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25606] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25606/stat : 25606 (java) S 25599 25601 24746 0 -1 4202560 910 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25607] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25607/stat : 25607 (java) S 25599 25601 24746 0 -1 4202560 447 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25608] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25608/stat : 25608 (java) S 25599 25601 24746 0 -1 4202560 857 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25609] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25609/stat : 25609 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25610] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25610/stat : 25610 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25611] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25611/stat : 25611 (java) S 25599 25601 24746 0 -1 4202560 386 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25612] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25612/stat : 25612 (java) S 25599 25601 24746 0 -1 4202560 72 0 0 0 0 0 0 0 18 0 22 0 503698017 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 0 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25613] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25613/stat : 25613 (java) S 25599 25601 24746 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 503698017 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25614] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25614/stat : 25614 (java) S 25599 25601 24746 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 503698017 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25615] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25615/stat : 25615 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051478961 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25616] ppid=25599 vsize=15780420 CPUtime=0.71 cores=1,3,5,7
/proc/25601/task/25616/stat : 25616 (java) S 25599 25601 24746 0 -1 4202560 12682 0 0 0 70 1 0 0 21 0 22 0 503698019 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25617] ppid=25599 vsize=15780420 CPUtime=0.22 cores=1,3,5,7
/proc/25601/task/25617/stat : 25617 (java) R 25599 25601 24746 0 -1 4202560 3187 0 0 0 22 0 0 0 15 0 22 0 503698019 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46922883431624 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25619] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25619/stat : 25619 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 503698019 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25624] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25624/stat : 25624 (java) S 25599 25601 24746 0 -1 4202560 14 0 0 0 0 0 0 0 18 0 22 0 503698091 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25625] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25625/stat : 25625 (java) S 25599 25601 24746 0 -1 4202560 13 0 0 0 0 0 0 0 18 0 22 0 503698091 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25626] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25626/stat : 25626 (java) S 25599 25601 24746 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 22 0 503698091 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25627] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25627/stat : 25627 (java) S 25599 25601 24746 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 22 0 503698091 16159150080 51088 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.45
Current children cumulated vsize (KiB) 15780420

[startup+3.11034 s]
/proc/loadavg: 6.92 7.86 7.85 8/220 25627
/proc/meminfo: memFree=30520904/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15780420 CPUtime=5.84 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 87395 0 1 0 572 12 0 0 21 0 22 0 503698015 16159150080 79632 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3945105 79633 2274 9 0 3935824 0
[pid=25601/tid=25602] ppid=25599 vsize=15780420 CPUtime=2.15 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) S 25599 25601 24746 0 -1 4202560 35707 0 1 0 210 5 0 0 25 0 22 0 503698015 16159150080 79634 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25604] ppid=25599 vsize=15780420 CPUtime=0.02 cores=1,3,5,7
/proc/25601/task/25604/stat : 25604 (java) S 25599 25601 24746 0 -1 4202560 4564 0 0 0 2 0 0 0 15 0 22 0 503698016 16159150080 79635 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25605] ppid=25599 vsize=15780420 CPUtime=0.02 cores=1,3,5,7
/proc/25601/task/25605/stat : 25605 (java) S 25599 25601 24746 0 -1 4202560 3541 0 0 0 2 0 0 0 18 0 22 0 503698016 16159150080 79635 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25606] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25606/stat : 25606 (java) S 25599 25601 24746 0 -1 4202560 1235 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 79636 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25607] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25607/stat : 25607 (java) S 25599 25601 24746 0 -1 4202560 447 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 79637 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25608] ppid=25599 vsize=15780420 CPUtime=0.02 cores=1,3,5,7
/proc/25601/task/25608/stat : 25608 (java) S 25599 25601 24746 0 -1 4202560 5511 0 0 0 2 0 0 0 18 0 22 0 503698016 16159150080 79637 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25609] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25609/stat : 25609 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 79638 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25610] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25610/stat : 25610 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 503698016 16159150080 79639 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25611] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25611/stat : 25611 (java) S 25599 25601 24746 0 -1 4202560 386 0 0 0 0 0 0 0 18 0 22 0 503698016 16159150080 79639 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25612] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25612/stat : 25612 (java) S 25599 25601 24746 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 79640 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 0 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25613] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25613/stat : 25613 (java) S 25599 25601 24746 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 503698017 16159150080 79641 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25614] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25614/stat : 25614 (java) S 25599 25601 24746 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 503698017 16159150080 79642 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25615] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25615/stat : 25615 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 79642 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051478961 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25616] ppid=25599 vsize=15780420 CPUtime=1.02 cores=1,3,5,7
/proc/25601/task/25616/stat : 25616 (java) S 25599 25601 24746 0 -1 4202560 12763 0 0 0 101 1 0 0 15 0 22 0 503698019 16159150080 79643 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25617] ppid=25599 vsize=15780420 CPUtime=0.94 cores=1,3,5,7
/proc/25601/task/25617/stat : 25617 (java) S 25599 25601 24746 0 -1 4202560 5171 0 0 0 94 0 0 0 15 0 22 0 503698019 16159150080 79644 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 79644 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25619] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25619/stat : 25619 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 503698019 16159150080 79645 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25624] ppid=25599 vsize=15780420 CPUtime=0.13 cores=1,3,5,7
/proc/25601/task/25624/stat : 25624 (java) R 25599 25601 24746 0 -1 4202560 5331 0 0 0 13 0 0 0 15 0 22 0 503698091 16159150080 79646 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46912506296086 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25601/tid=25625] ppid=25599 vsize=15780420 CPUtime=0.59 cores=1,3,5,7
/proc/25601/task/25625/stat : 25625 (java) R 25599 25601 24746 0 -1 4202560 1135 0 0 0 59 0 0 0 16 0 22 0 503698091 16159150080 79647 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46922888962208 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=25601/tid=25626] ppid=25599 vsize=15780420 CPUtime=0.4 cores=1,3,5,7
/proc/25601/task/25626/stat : 25626 (java) R 25599 25601 24746 0 -1 4202560 5423 0 0 0 40 0 0 0 15 0 22 0 503698091 16159150080 79648 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46912505523432 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=25601/tid=25627] ppid=25599 vsize=15780420 CPUtime=0.43 cores=1,3,5,7
/proc/25601/task/25627/stat : 25627 (java) R 25599 25601 24746 0 -1 4202560 4734 0 0 0 43 0 0 0 16 0 22 0 503698091 16159150080 79648 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46912506343024 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.84
Current children cumulated vsize (KiB) 15780420

[startup+6.30075 s]
/proc/loadavg: 7.16 7.90 7.86 10/220 25627
/proc/meminfo: memFree=28693240/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15780420 CPUtime=18.56 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 267090 0 1 0 1821 35 0 0 21 0 22 0 503698015 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3945105 258944 2274 9 0 3935824 0
[pid=25601/tid=25602] ppid=25599 vsize=15780420 CPUtime=2.15 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) S 25599 25601 24746 0 -1 4202560 35707 0 1 0 210 5 0 0 25 0 22 0 503698015 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25604] ppid=25599 vsize=15780420 CPUtime=0.09 cores=1,3,5,7
/proc/25601/task/25604/stat : 25604 (java) S 25599 25601 24746 0 -1 4202560 14710 0 0 0 8 1 0 0 15 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25605] ppid=25599 vsize=15780420 CPUtime=0.08 cores=1,3,5,7
/proc/25601/task/25605/stat : 25605 (java) S 25599 25601 24746 0 -1 4202560 12600 0 0 0 7 1 0 0 16 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25606] ppid=25599 vsize=15780420 CPUtime=0.06 cores=1,3,5,7
/proc/25601/task/25606/stat : 25606 (java) S 25599 25601 24746 0 -1 4202560 9483 0 0 0 6 0 0 0 15 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25607] ppid=25599 vsize=15780420 CPUtime=0.08 cores=1,3,5,7
/proc/25601/task/25607/stat : 25607 (java) S 25599 25601 24746 0 -1 4202560 11263 0 0 0 7 1 0 0 15 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25608] ppid=25599 vsize=15780420 CPUtime=0.13 cores=1,3,5,7
/proc/25601/task/25608/stat : 25608 (java) S 25599 25601 24746 0 -1 4202560 30273 0 0 0 9 4 0 0 15 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25609] ppid=25599 vsize=15780420 CPUtime=0.13 cores=1,3,5,7
/proc/25601/task/25609/stat : 25609 (java) S 25599 25601 24746 0 -1 4202560 25909 0 0 0 10 3 0 0 15 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25610] ppid=25599 vsize=15780420 CPUtime=0.1 cores=1,3,5,7
/proc/25601/task/25610/stat : 25610 (java) S 25599 25601 24746 0 -1 4202560 22596 0 0 0 7 3 0 0 16 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25611] ppid=25599 vsize=15780420 CPUtime=0.03 cores=1,3,5,7
/proc/25601/task/25611/stat : 25611 (java) S 25599 25601 24746 0 -1 4202560 9522 0 0 0 3 0 0 0 15 0 22 0 503698016 16159150080 258944 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0

################
# More data... #
################

/proc/25601/task/25608/stat : 25608 (java) S 25599 25601 24746 0 -1 4202560 321456 0 0 0 184 53 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25609] ppid=25599 vsize=15780420 CPUtime=1.9 cores=1,3,5,7
/proc/25601/task/25609/stat : 25609 (java) S 25599 25601 24746 0 -1 4202560 260713 0 0 0 151 39 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25610] ppid=25599 vsize=15780420 CPUtime=2.41 cores=1,3,5,7
/proc/25601/task/25610/stat : 25610 (java) S 25599 25601 24746 0 -1 4202560 332666 0 0 0 188 53 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25611] ppid=25599 vsize=15780420 CPUtime=2.61 cores=1,3,5,7
/proc/25601/task/25611/stat : 25611 (java) S 25599 25601 24746 0 -1 4202560 346123 0 0 0 204 57 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25612] ppid=25599 vsize=15780420 CPUtime=883.35 cores=1,3,5,7
/proc/25601/task/25612/stat : 25612 (java) R 25599 25601 24746 0 -1 4202560 649693 0 0 0 88221 114 0 0 18 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212039346168 0 0 0 16800975 0 0 0 -1 1 0 0 0
[pid=25601/tid=25613] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25613/stat : 25613 (java) S 25599 25601 24746 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25614] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25614/stat : 25614 (java) S 25599 25601 24746 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25615] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25615/stat : 25615 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051478961 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25616] ppid=25599 vsize=15780420 CPUtime=1.29 cores=1,3,5,7
/proc/25601/task/25616/stat : 25616 (java) S 25599 25601 24746 0 -1 4202560 12795 0 0 0 128 1 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25617] ppid=25599 vsize=15780420 CPUtime=0.94 cores=1,3,5,7
/proc/25601/task/25617/stat : 25617 (java) S 25599 25601 24746 0 -1 4202560 5171 0 0 0 94 0 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25619] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25619/stat : 25619 (java) S 25599 25601 24746 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25624] ppid=25599 vsize=15780420 CPUtime=290.46 cores=1,3,5,7
/proc/25601/task/25624/stat : 25624 (java) S 25599 25601 24746 0 -1 4202560 99402 0 0 0 29025 21 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25625] ppid=25599 vsize=15780420 CPUtime=290.48 cores=1,3,5,7
/proc/25601/task/25625/stat : 25625 (java) S 25599 25601 24746 0 -1 4202560 101349 0 0 0 29031 17 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25626] ppid=25599 vsize=15780420 CPUtime=289.28 cores=1,3,5,7
/proc/25601/task/25626/stat : 25626 (java) S 25599 25601 24746 0 -1 4202560 101275 0 0 0 28907 21 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25627] ppid=25599 vsize=15780420 CPUtime=290.69 cores=1,3,5,7
/proc/25601/task/25627/stat : 25627 (java) S 25599 25601 24746 0 -1 4202560 100569 0 0 0 29051 18 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2069.41
Current children cumulated vsize (KiB) 15780420

[startup+1242.3 s]
/proc/loadavg: 3.19 4.73 5.93 2/193 25680
/proc/meminfo: memFree=15688736/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15780420 CPUtime=2130.1 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 3887220 0 1 0 212348 662 0 0 21 0 22 0 503698015 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3945105 3850936 2293 9 0 3935824 0
[pid=25601/tid=25602] ppid=25599 vsize=15780420 CPUtime=2.15 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) S 25599 25601 24746 0 -1 4202560 35707 0 1 0 210 5 0 0 25 0 22 0 503698015 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25604] ppid=25599 vsize=15780420 CPUtime=2.66 cores=1,3,5,7
/proc/25601/task/25604/stat : 25604 (java) S 25599 25601 24746 0 -1 4202560 373177 0 0 0 204 62 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25605] ppid=25599 vsize=15780420 CPUtime=3.41 cores=1,3,5,7
/proc/25601/task/25605/stat : 25605 (java) S 25599 25601 24746 0 -1 4202560 459391 0 0 0 266 75 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25606] ppid=25599 vsize=15780420 CPUtime=2.77 cores=1,3,5,7
/proc/25601/task/25606/stat : 25606 (java) S 25599 25601 24746 0 -1 4202560 374377 0 0 0 216 61 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25607] ppid=25599 vsize=15780420 CPUtime=2.46 cores=1,3,5,7
/proc/25601/task/25607/stat : 25607 (java) S 25599 25601 24746 0 -1 4202560 311402 0 0 0 197 49 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25608] ppid=25599 vsize=15780420 CPUtime=2.37 cores=1,3,5,7
/proc/25601/task/25608/stat : 25608 (java) S 25599 25601 24746 0 -1 4202560 321456 0 0 0 184 53 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25609] ppid=25599 vsize=15780420 CPUtime=1.9 cores=1,3,5,7
/proc/25601/task/25609/stat : 25609 (java) S 25599 25601 24746 0 -1 4202560 260713 0 0 0 151 39 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25610] ppid=25599 vsize=15780420 CPUtime=2.41 cores=1,3,5,7
/proc/25601/task/25610/stat : 25610 (java) S 25599 25601 24746 0 -1 4202560 332666 0 0 0 188 53 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25611] ppid=25599 vsize=15780420 CPUtime=2.61 cores=1,3,5,7
/proc/25601/task/25611/stat : 25611 (java) S 25599 25601 24746 0 -1 4202560 346123 0 0 0 204 57 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25612] ppid=25599 vsize=15780420 CPUtime=943.1 cores=1,3,5,7
/proc/25601/task/25612/stat : 25612 (java) R 25599 25601 24746 0 -1 4202560 649697 0 0 0 94192 118 0 0 18 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46922886037820 0 0 0 16800975 0 0 0 -1 3 0 0 0
[pid=25601/tid=25613] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25613/stat : 25613 (java) S 25599 25601 24746 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25614] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25614/stat : 25614 (java) S 25599 25601 24746 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25615] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25615/stat : 25615 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051478961 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25616] ppid=25599 vsize=15780420 CPUtime=1.29 cores=1,3,5,7
/proc/25601/task/25616/stat : 25616 (java) S 25599 25601 24746 0 -1 4202560 12795 0 0 0 128 1 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25617] ppid=25599 vsize=15780420 CPUtime=0.94 cores=1,3,5,7
/proc/25601/task/25617/stat : 25617 (java) S 25599 25601 24746 0 -1 4202560 5171 0 0 0 94 0 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25619] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25619/stat : 25619 (java) S 25599 25601 24746 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25624] ppid=25599 vsize=15780420 CPUtime=290.68 cores=1,3,5,7
/proc/25601/task/25624/stat : 25624 (java) S 25599 25601 24746 0 -1 4202560 99475 0 0 0 29046 22 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25625] ppid=25599 vsize=15780420 CPUtime=290.72 cores=1,3,5,7
/proc/25601/task/25625/stat : 25625 (java) S 25599 25601 24746 0 -1 4202560 101373 0 0 0 29055 17 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25626] ppid=25599 vsize=15780420 CPUtime=289.52 cores=1,3,5,7
/proc/25601/task/25626/stat : 25626 (java) S 25599 25601 24746 0 -1 4202560 101526 0 0 0 28931 21 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25627] ppid=25599 vsize=15780420 CPUtime=290.93 cores=1,3,5,7
/proc/25601/task/25627/stat : 25627 (java) S 25599 25601 24746 0 -1 4202560 100714 0 0 0 29074 19 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2130.1
Current children cumulated vsize (KiB) 15780420



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.80 4.05 5.62 2/193 25681
/proc/meminfo: memFree=15688528/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=15780420 CPUtime=2189.64 cores=1,3,5,7
/proc/25601/stat : 25601 (java) S 25599 25601 24746 0 -1 4202496 3887730 0 1 0 218295 669 0 0 21 0 22 0 503698015 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 3945105 3850936 2293 9 0 3935824 0
[pid=25601/tid=25602] ppid=25599 vsize=15780420 CPUtime=2.15 cores=1,3,5,7
/proc/25601/task/25602/stat : 25602 (java) S 25599 25601 24746 0 -1 4202560 35707 0 1 0 210 5 0 0 25 0 22 0 503698015 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25604] ppid=25599 vsize=15780420 CPUtime=2.66 cores=1,3,5,7
/proc/25601/task/25604/stat : 25604 (java) S 25599 25601 24746 0 -1 4202560 373177 0 0 0 204 62 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25605] ppid=25599 vsize=15780420 CPUtime=3.41 cores=1,3,5,7
/proc/25601/task/25605/stat : 25605 (java) S 25599 25601 24746 0 -1 4202560 459391 0 0 0 266 75 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25606] ppid=25599 vsize=15780420 CPUtime=2.77 cores=1,3,5,7
/proc/25601/task/25606/stat : 25606 (java) S 25599 25601 24746 0 -1 4202560 374377 0 0 0 216 61 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25607] ppid=25599 vsize=15780420 CPUtime=2.46 cores=1,3,5,7
/proc/25601/task/25607/stat : 25607 (java) S 25599 25601 24746 0 -1 4202560 311402 0 0 0 197 49 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25608] ppid=25599 vsize=15780420 CPUtime=2.37 cores=1,3,5,7
/proc/25601/task/25608/stat : 25608 (java) S 25599 25601 24746 0 -1 4202560 321456 0 0 0 184 53 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25609] ppid=25599 vsize=15780420 CPUtime=1.9 cores=1,3,5,7
/proc/25601/task/25609/stat : 25609 (java) S 25599 25601 24746 0 -1 4202560 260713 0 0 0 151 39 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 7 0 0 0
[pid=25601/tid=25610] ppid=25599 vsize=15780420 CPUtime=2.41 cores=1,3,5,7
/proc/25601/task/25610/stat : 25610 (java) S 25599 25601 24746 0 -1 4202560 332666 0 0 0 188 53 0 0 15 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25611] ppid=25599 vsize=15780420 CPUtime=2.61 cores=1,3,5,7
/proc/25601/task/25611/stat : 25611 (java) S 25599 25601 24746 0 -1 4202560 346123 0 0 0 204 57 0 0 16 0 22 0 503698016 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25612] ppid=25599 vsize=15780420 CPUtime=1000.19 cores=1,3,5,7
/proc/25601/task/25612/stat : 25612 (java) R 25599 25601 24746 0 -1 4202560 649701 0 0 0 99896 123 0 0 19 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 46922888731930 0 0 0 16800975 0 0 0 -1 3 0 0 0
[pid=25601/tid=25613] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25613/stat : 25613 (java) S 25599 25601 24746 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25614] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25614/stat : 25614 (java) S 25599 25601 24746 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 503698017 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25615] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25615/stat : 25615 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051478961 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25616] ppid=25599 vsize=15780420 CPUtime=1.29 cores=1,3,5,7
/proc/25601/task/25616/stat : 25616 (java) S 25599 25601 24746 0 -1 4202560 12795 0 0 0 128 1 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25617] ppid=25599 vsize=15780420 CPUtime=0.94 cores=1,3,5,7
/proc/25601/task/25617/stat : 25617 (java) S 25599 25601 24746 0 -1 4202560 5171 0 0 0 94 0 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) S 25599 25601 24746 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25619] ppid=25599 vsize=15780420 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25619/stat : 25619 (java) S 25599 25601 24746 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 22 0 503698019 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471872 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25624] ppid=25599 vsize=15780420 CPUtime=291.31 cores=1,3,5,7
/proc/25601/task/25624/stat : 25624 (java) S 25599 25601 24746 0 -1 4202560 99492 0 0 0 29108 23 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 1 0 0 0
[pid=25601/tid=25625] ppid=25599 vsize=15780420 CPUtime=291.35 cores=1,3,5,7
/proc/25601/task/25625/stat : 25625 (java) S 25599 25601 24746 0 -1 4202560 101389 0 0 0 29117 18 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 5 0 0 0
[pid=25601/tid=25626] ppid=25599 vsize=15780420 CPUtime=290.13 cores=1,3,5,7
/proc/25601/task/25626/stat : 25626 (java) S 25599 25601 24746 0 -1 4202560 101586 0 0 0 28991 22 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
[pid=25601/tid=25627] ppid=25599 vsize=15780420 CPUtime=291.53 cores=1,3,5,7
/proc/25601/task/25627/stat : 25627 (java) S 25599 25601 24746 0 -1 4202560 101123 0 0 0 29134 19 0 0 15 0 22 0 503698091 16159150080 3850936 33554432000 1073741824 1073778376 140734960189776 18446744073709551615 212051471257 0 4 0 16800975 18446604471145675712 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2189.64
Current children cumulated vsize (KiB) 15780420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -25601

[startup+1302.3 s]
/proc/loadavg: 1.80 4.05 5.62 2/194 25682
/proc/meminfo: memFree=15688396/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=0 CPUtime=2191.94 cores=1,3,5,7
/proc/25601/stat : 25601 (java) Z 25599 25601 24746 0 -1 4203548 3887754 0 1 0 218496 698 0 0 18 0 2 0 503698015 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 0 0 0 0 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=0 CPUtime=0.28 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) R 25599 25601 24746 0 -1 4203588 1 0 0 0 0 28 0 0 18 0 2 0 503698019 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2191.94
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.5 s]
/proc/loadavg: 1.80 4.05 5.62 2/194 25682
/proc/meminfo: memFree=15688396/32951124 swapFree=67106388/67111528
[pid=25601] ppid=25599 vsize=0 CPUtime=2192.14 cores=1,3,5,7
/proc/25601/stat : 25601 (java) Z 25599 25601 24746 0 -1 4203548 3887754 0 1 0 218496 718 0 0 18 0 2 0 503698015 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/25601/statm: 0 0 0 0 0 0 0
[pid=25601/tid=25618] ppid=25599 vsize=0 CPUtime=0.48 cores=1,3,5,7
/proc/25601/task/25618/stat : 25618 (java) R 25599 25601 24746 0 -1 4203588 1 0 0 0 0 48 0 0 18 0 2 0 503698019 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2192.14
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.52
CPU time (s): 2192.17
CPU user time (s): 2184.96
CPU system time (s): 7.2049
CPU usage (%): 168.301
Max. virtual memory (cumulated for all children) (KiB): 15782996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2184.96
system time used= 7.2049
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3887754
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 80804
involuntary context switches= 44724

runsolver used 2.21866 second user time and 4.95525 second system time

The end

Launcher Data 

Begin job on node146 at 2011-04-29 23:33:38
IDJOB=3311171
IDBENCH=82556
IDSOLVER=1698
FILE ID=node146/3311171-1304112817
RUNJOBID= node146-1304112817-25565
PBS_JOBID= 13170656
Free space on /tmp= 72992 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v30000-c126000-S1196935200-064-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311171-1304112817/watcher-3311171-1304112817 -o /tmp/evaluation-result-3311171-1304112817/solver-3311171-1304112817 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311171-1304112817.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a5ac359cd8af4f1e83d886effb49a2a9
RANDOM SEED=1465694279

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31104696 kB
Buffers:        378760 kB
Cached:        1025216 kB
SwapCached:        540 kB
Active:          93456 kB
Inactive:      1380344 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31104696 kB
SwapTotal:    67111528 kB
SwapFree:     67106388 kB
Dirty:            6000 kB
Writeback:           0 kB
AnonPages:       69196 kB
Mapped:          22416 kB
Slab:           309800 kB
PageTables:       4592 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   774156 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72992 MiB
End job on node146 at 2011-04-29 23:55:20