Trace number 3311772

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 1705.45 1302.62

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1520_u.cnf
MD5SUMac02a3a5c06227748ecf75dd451ebb7e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63840
Number of clauses123900
Sum of the clauses size369320
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22380
Number of clauses of size 3121520
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	19:55 INFO : Reading from input HOME/instance-3311772-1304183995.cnf
0.94/0.75	Executor set job limit to 1000000
0.94/0.75	Executor set job limit to 1000000
0.94/0.75	Executor set job limit to 1000000
0.94/0.75	Executor set job limit to 1000000
0.94/0.75	Starting Executor!
0.94/0.75	Starting Executor!
0.94/0.75	Starting Executor!
0.94/0.75	Starting Executor!
3.29/1.94	19:57 INFO : 63800 variables remaining out of 63840
3.29/1.94	19:57 INFO : 500034 literals remaining out of 493220
608.00/208.74	22:45 ERROR: Failed to solve instance
608.00/208.74	java.lang.OutOfMemoryError: Java heap space
608.00/208.74		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:222)
608.00/208.74		at gnu.trove.THash.postInsertHook(THash.java:370)
608.00/208.74		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
608.00/208.74		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
608.00/208.74		at ibis.structure.Subsumming.run(Subsumming.java:58)
608.00/208.74		at ibis.structure.Solver.simplify(Solver.java:205)
608.00/208.74		at ibis.structure.Solver.solve(Solver.java:113)
608.00/208.74		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
608.00/208.74		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
608.00/208.74		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
608.00/208.74		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
608.00/208.74		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
608.00/208.74		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
608.00/208.74		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
608.00/208.74		at ibis.constellation.Executor.processActivities(Executor.java:75)
608.00/208.74		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
608.00/208.74		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
608.00/208.74		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
618.03/218.71	23:33 ERROR: Failed to solve instance
618.03/218.71	java.lang.OutOfMemoryError: Java heap space
618.03/218.71		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:222)
618.03/218.71		at gnu.trove.THash.postInsertHook(THash.java:370)
618.03/218.71		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
618.03/218.71		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
618.03/218.71		at ibis.structure.Subsumming.run(Subsumming.java:58)
618.03/218.71		at ibis.structure.Solver.simplify(Solver.java:205)
618.03/218.71		at ibis.structure.Solver.solve(Solver.java:113)
618.03/218.71		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
618.03/218.71		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
618.03/218.71		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
618.03/218.71		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
618.03/218.71		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
618.03/218.71		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
618.03/218.71		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
618.03/218.71		at ibis.constellation.Executor.processActivities(Executor.java:75)
618.03/218.71		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
618.03/218.71		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
618.03/218.71		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
626.27/226.90	23:38 ERROR: Failed to solve instance
626.27/226.90	java.lang.OutOfMemoryError: Java heap space
626.27/226.90		at ibis.structure.HyperBinaryResolution.<init>(HyperBinaryResolution.java:50)
626.27/226.90		at ibis.structure.Solver.simplify(Solver.java:191)
626.27/226.90		at ibis.structure.Solver.solve(Solver.java:113)
626.27/226.90		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
626.27/226.90		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
626.27/226.90		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
626.27/226.90		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
626.27/226.90		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
626.27/226.90		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
626.27/226.90		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
626.27/226.90		at ibis.constellation.Executor.processActivities(Executor.java:75)
626.27/226.90		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
626.27/226.90		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
626.27/226.90		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
628.56/229.29	23:41 ERROR: Failed to solve instance
628.56/229.29	java.lang.OutOfMemoryError: Java heap space
628.56/229.29		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
628.56/229.29		at gnu.trove.THash.postInsertHook(THash.java:370)
628.56/229.29		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
628.56/229.29		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
628.56/229.29		at ibis.structure.Subsumming.run(Subsumming.java:58)
628.56/229.29		at ibis.structure.Solver.simplify(Solver.java:205)
628.56/229.29		at ibis.structure.Solver.solve(Solver.java:113)
628.56/229.29		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
628.56/229.29		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
628.56/229.29		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
628.56/229.29		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
628.56/229.29		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
628.56/229.29		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
628.56/229.29		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
628.56/229.29		at ibis.constellation.Executor.processActivities(Executor.java:75)
628.56/229.29		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
628.56/229.29		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
628.56/229.29		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
633.94/234.55	23:49 ERROR: Failed to solve instance
633.94/234.55	java.lang.OutOfMemoryError: Java heap space
635.68/236.25	23:51 ERROR: Failed to solve instance
635.68/236.25	java.lang.OutOfMemoryError: Java heap space
637.14/237.63	23:52 ERROR: Failed to solve instance
637.14/237.63	java.lang.OutOfMemoryError: Java heap space
638.49/238.95	23:54 ERROR: Failed to solve instance
638.49/238.95	java.lang.OutOfMemoryError: Java heap space
647.58/247.41	24:02 ERROR: Failed to solve instance
647.58/247.41	java.lang.OutOfMemoryError: Java heap space
1167.53/767.39	32:42 ERROR: Failed to solve instance
1167.53/767.39	java.lang.OutOfMemoryError: Java heap space
1223.79/823.50	33:32 ERROR: Failed to solve instance
1223.79/823.50	java.lang.OutOfMemoryError: Java heap space
1529.99/1129.77	38:44 ERROR: Failed to solve instance
1529.99/1129.77	java.lang.OutOfMemoryError: Java heap space
1534.92/1134.61	38:49 ERROR: Failed to solve instance
1534.92/1134.61	java.lang.OutOfMemoryError: Java heap space
1537.04/1136.71	38:52 ERROR: Failed to solve instance
1537.04/1136.71	java.lang.OutOfMemoryError: Java heap space
1559.08/1158.79	39:14 ERROR: Failed to solve instance
1559.08/1158.79	java.lang.OutOfMemoryError: Java heap space
1560.93/1160.57	39:15 ERROR: Failed to solve instance
1560.93/1160.57	java.lang.OutOfMemoryError: Java heap space
1563.29/1162.86	39:18 ERROR: Failed to solve instance
1563.29/1162.86	java.lang.OutOfMemoryError: Java heap space
1563.29/1162.87	39:18 ERROR: Failed to solve instance
1563.29/1162.87	java.lang.OutOfMemoryError: Java heap space
1573.65/1172.56	39:27 ERROR: Failed to solve instance
1573.65/1172.56	java.lang.OutOfMemoryError: Java heap space
1576.50/1175.30	39:30 ERROR: Failed to solve instance
1576.50/1175.30	java.lang.OutOfMemoryError: Java heap space
1578.85/1177.66	39:33 ERROR: Failed to solve instance
1578.85/1177.66	java.lang.OutOfMemoryError: Java heap space
1580.37/1179.16	39:34 ERROR: Failed to solve instance
1580.37/1179.16	java.lang.OutOfMemoryError: Java heap space
1580.67/1179.48	39:34 ERROR: Failed to solve instance
1580.67/1179.48	java.lang.OutOfMemoryError: Java heap space
1582.07/1180.80	39:35 ERROR: Failed to solve instance
1582.07/1180.80	java.lang.OutOfMemoryError: Java heap space
1586.41/1185.10	39:40 ERROR: Failed to solve instance
1586.41/1185.10	java.lang.OutOfMemoryError: Java heap space
1590.46/1189.14	39:44 ERROR: Failed to solve instance
1590.46/1189.14	java.lang.OutOfMemoryError: Java heap space
1592.09/1190.78	39:45 ERROR: Failed to solve instance
1592.09/1190.78	java.lang.OutOfMemoryError: Java heap space
1596.91/1195.28	39:50 ERROR: Failed to solve instance
1596.91/1195.28	java.lang.OutOfMemoryError: Java heap space
1599.23/1197.59	39:52 ERROR: Failed to solve instance
1599.23/1197.59	java.lang.OutOfMemoryError: Java heap space
1614.44/1212.65	40:08 ERROR: Failed to solve instance
1614.44/1212.65	java.lang.OutOfMemoryError: Java heap space
1624.27/1222.20	40:17 ERROR: Failed to solve instance
1624.27/1222.20	java.lang.OutOfMemoryError: Java heap space
1642.28/1240.09	40:35 ERROR: Failed to solve instance
1642.28/1240.09	java.lang.OutOfMemoryError: Java heap space
1646.31/1243.95	Exception in thread "SingleThreadedConstellation 3" java.lang.OutOfMemoryError: Java heap space
1648.31/1245.96	40:41 ERROR: Failed to solve instance
1648.31/1245.96	java.lang.OutOfMemoryError: Java heap space
1653.94/1251.34	40:46 ERROR: Failed to solve instance
1653.94/1251.34	java.lang.OutOfMemoryError: Java heap space
1657.53/1254.72	40:50 ERROR: Failed to solve instance
1657.53/1254.72	java.lang.OutOfMemoryError: Java heap space

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311772-1304183995/watcher-3311772-1304183995 -o /tmp/evaluation-result-3311772-1304183995/solver-3311772-1304183995 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311772-1304183995.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.10 7.77 7.64 2/194 1626
/proc/meminfo: memFree=29662912/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=20404 CPUtime=0 cores=0,2,4,6
/proc/1626/stat : 1626 (java) R 1624 1626 802 0 -1 4202496 673 0 0 0 0 0 0 0 25 0 1 0 608630152 20893696 160 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256410467975 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/1626/statm: 5101 160 128 9 0 124 0
[pid=1626/tid=1627] ppid=1624 vsize=28384 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) R 1624 1626 802 0 -1 4202560 71 0 0 0 0 0 0 0 25 0 2 0 608630153 29065216 898 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256410467975 0 0 4096 0 0 0 0 -1 4 0 0 0

[startup+0.0625291 s]
/proc/loadavg: 7.10 7.77 7.64 2/194 1626
/proc/meminfo: memFree=29662912/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15609780 CPUtime=0.05 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 4331 0 1 0 4 1 0 0 25 0 18 0 608630152 15984414720 3770 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3902445 3771 1778 9 0 3893164 0
[pid=1626/tid=1627] ppid=1624 vsize=15609780 CPUtime=0.04 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) R 1624 1626 802 0 -1 4202560 2915 0 1 0 4 0 0 0 25 0 18 0 608630153 15984414720 3772 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256415052485 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15609780

[startup+0.10056 s]
/proc/loadavg: 7.10 7.77 7.64 2/194 1626
/proc/meminfo: memFree=29662912/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15676908 CPUtime=0.1 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 5602 0 1 0 9 1 0 0 25 0 18 0 608630152 16053153792 5029 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3919227 5029 2118 9 0 3909946 0
[pid=1626/tid=1627] ppid=1624 vsize=15676908 CPUtime=0.08 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) R 1624 1626 802 0 -1 4202560 3476 0 1 0 7 1 0 0 18 0 18 0 608630153 16053153792 5029 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427218379 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676908

[startup+0.300503 s]
/proc/loadavg: 7.10 7.77 7.64 2/194 1626
/proc/meminfo: memFree=29662912/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15680776 CPUtime=0.52 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 15282 0 1 0 50 2 0 0 25 0 18 0 608630152 16057114624 13781 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3920194 13787 2207 9 0 3910913 0
[pid=1626/tid=1627] ppid=1624 vsize=15680776 CPUtime=0.29 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) R 1624 1626 802 0 -1 4202560 10302 0 1 0 27 2 0 0 18 0 18 0 608630153 16057114624 13790 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 46912505640211 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15680776

[startup+0.700371 s]
/proc/loadavg: 7.10 7.77 7.64 2/194 1626
/proc/meminfo: memFree=29662912/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15680776 CPUtime=0.94 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 41772 0 1 0 88 6 0 0 25 0 18 0 608630152 16057114624 40268 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3920194 40268 2223 9 0 3910913 0
[pid=1626/tid=1627] ppid=1624 vsize=15680776 CPUtime=0.68 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) R 1624 1626 802 0 -1 4202560 35541 0 1 0 63 5 0 0 18 0 18 0 608630153 16057114624 40268 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 46912505529035 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.94
Current children cumulated vsize (KiB) 15680776

[startup+1.50121 s]
/proc/loadavg: 7.10 7.77 7.64 10/220 1652
/proc/meminfo: memFree=29299696/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15704868 CPUtime=2.46 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 54065 0 1 0 239 7 0 0 25 0 22 0 608630152 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3926217 48771 2265 9 0 3916936 0
[pid=1626/tid=1627] ppid=1624 vsize=15704868 CPUtime=1.47 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) R 1624 1626 802 0 -1 4202560 35650 0 1 0 142 5 0 0 21 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 46912505121414 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=1626/tid=1629] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1629/stat : 1629 (java) S 1624 1626 802 0 -1 4202560 109 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1630] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1630/stat : 1630 (java) S 1624 1626 802 0 -1 4202560 376 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1631] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1631/stat : 1631 (java) S 1624 1626 802 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1632] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1632/stat : 1632 (java) S 1624 1626 802 0 -1 4202560 553 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1633] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1633/stat : 1633 (java) S 1624 1626 802 0 -1 4202560 1657 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1634] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1634/stat : 1634 (java) S 1624 1626 802 0 -1 4202560 71 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1635] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1635/stat : 1635 (java) S 1624 1626 802 0 -1 4202560 34 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1636] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1636/stat : 1636 (java) S 1624 1626 802 0 -1 4202560 1836 0 0 0 0 0 0 0 18 0 22 0 608630153 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1637] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1637/stat : 1637 (java) S 1624 1626 802 0 -1 4202560 73 0 0 0 0 0 0 0 18 0 22 0 608630154 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 0 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1638] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1638/stat : 1638 (java) S 1624 1626 802 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 608630155 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) S 1624 1626 802 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608630155 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1640] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1640/stat : 1640 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427215281 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1641] ppid=1624 vsize=15704868 CPUtime=0.47 cores=0,2,4,6
/proc/1626/task/1641/stat : 1641 (java) R 1624 1626 802 0 -1 4202560 8111 0 0 0 47 0 0 0 15 0 22 0 608630157 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 47305551247493 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=1626/tid=1642] ppid=1624 vsize=15704868 CPUtime=0.46 cores=0,2,4,6
/proc/1626/task/1642/stat : 1642 (java) S 1624 1626 802 0 -1 4202560 4151 0 0 0 46 0 0 0 17 0 22 0 608630157 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1643] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1643/stat : 1643 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1644] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1644/stat : 1644 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608630157 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1649] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1649/stat : 1649 (java) S 1624 1626 802 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 608630228 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1650] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1650/stat : 1650 (java) S 1624 1626 802 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 608630228 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1651] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1651/stat : 1651 (java) S 1624 1626 802 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 608630228 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1652] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1652/stat : 1652 (java) S 1624 1626 802 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 608630228 16081784832 48771 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.46
Current children cumulated vsize (KiB) 15704868

[startup+3.1049 s]
/proc/loadavg: 7.10 7.77 7.64 11/220 1652
/proc/meminfo: memFree=29035948/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15704868 CPUtime=6.33 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 128536 0 1 0 617 16 0 0 25 0 22 0 608630152 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3926217 122974 2275 9 0 3916936 0
[pid=1626/tid=1627] ppid=1624 vsize=15704868 CPUtime=1.92 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) S 1624 1626 802 0 -1 4202560 35694 0 1 0 187 5 0 0 22 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1629] ppid=1624 vsize=15704868 CPUtime=0.07 cores=0,2,4,6
/proc/1626/task/1629/stat : 1629 (java) S 1624 1626 802 0 -1 4202560 12176 0 0 0 6 1 0 0 16 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1630] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1630/stat : 1630 (java) S 1624 1626 802 0 -1 4202560 504 0 0 0 0 0 0 0 15 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1631] ppid=1624 vsize=15704868 CPUtime=0.01 cores=0,2,4,6
/proc/1626/task/1631/stat : 1631 (java) S 1624 1626 802 0 -1 4202560 2913 0 0 0 1 0 0 0 15 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1632] ppid=1624 vsize=15704868 CPUtime=0.03 cores=0,2,4,6
/proc/1626/task/1632/stat : 1632 (java) S 1624 1626 802 0 -1 4202560 4436 0 0 0 3 0 0 0 16 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1633] ppid=1624 vsize=15704868 CPUtime=0.08 cores=0,2,4,6
/proc/1626/task/1633/stat : 1633 (java) S 1624 1626 802 0 -1 4202560 13702 0 0 0 6 2 0 0 16 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1634] ppid=1624 vsize=15704868 CPUtime=0.03 cores=0,2,4,6
/proc/1626/task/1634/stat : 1634 (java) S 1624 1626 802 0 -1 4202560 4582 0 0 0 3 0 0 0 15 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1635] ppid=1624 vsize=15704868 CPUtime=0.02 cores=0,2,4,6
/proc/1626/task/1635/stat : 1635 (java) S 1624 1626 802 0 -1 4202560 3655 0 0 0 2 0 0 0 16 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1636] ppid=1624 vsize=15704868 CPUtime=0.05 cores=0,2,4,6
/proc/1626/task/1636/stat : 1636 (java) S 1624 1626 802 0 -1 4202560 9238 0 0 0 5 0 0 0 15 0 22 0 608630153 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1637] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1637/stat : 1637 (java) S 1624 1626 802 0 -1 4202560 269 0 0 0 0 0 0 0 15 0 22 0 608630154 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 0 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1638] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1638/stat : 1638 (java) S 1624 1626 802 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 608630155 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) S 1624 1626 802 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608630155 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1640] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1640/stat : 1640 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427215281 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1641] ppid=1624 vsize=15704868 CPUtime=0.91 cores=0,2,4,6
/proc/1626/task/1641/stat : 1641 (java) S 1624 1626 802 0 -1 4202560 8169 0 0 0 91 0 0 0 15 0 22 0 608630157 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1642] ppid=1624 vsize=15704868 CPUtime=0.9 cores=0,2,4,6
/proc/1626/task/1642/stat : 1642 (java) S 1624 1626 802 0 -1 4202560 4211 0 0 0 90 0 0 0 15 0 22 0 608630157 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1643] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1643/stat : 1643 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1644] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1644/stat : 1644 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608630157 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1649] ppid=1624 vsize=15704868 CPUtime=0.56 cores=0,2,4,6
/proc/1626/task/1649/stat : 1649 (java) R 1624 1626 802 0 -1 4202560 9800 0 0 0 55 1 0 0 15 0 22 0 608630228 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 47305551534118 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=1626/tid=1650] ppid=1624 vsize=15704868 CPUtime=0.32 cores=0,2,4,6
/proc/1626/task/1650/stat : 1650 (java) R 1624 1626 802 0 -1 4202560 935 0 0 0 32 0 0 0 16 0 22 0 608630228 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 47305551534178 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=1626/tid=1651] ppid=1624 vsize=15704868 CPUtime=0.74 cores=0,2,4,6
/proc/1626/task/1651/stat : 1651 (java) S 1624 1626 802 0 -1 4202560 7123 0 0 0 74 0 0 0 15 0 22 0 608630228 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1652] ppid=1624 vsize=15704868 CPUtime=0.55 cores=0,2,4,6
/proc/1626/task/1652/stat : 1652 (java) R 1624 1626 802 0 -1 4202560 9743 0 0 0 54 1 0 0 16 0 22 0 608630228 16081784832 122974 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 46912506445870 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.33
Current children cumulated vsize (KiB) 15704868

[startup+6.30125 s]
/proc/loadavg: 7.25 7.79 7.65 6/220 1652
/proc/meminfo: memFree=26309624/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15704868 CPUtime=18.49 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 461509 0 1 0 1782 67 0 0 25 0 22 0 608630152 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3926217 455419 2283 9 0 3916936 0
[pid=1626/tid=1627] ppid=1624 vsize=15704868 CPUtime=1.92 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) S 1624 1626 802 0 -1 4202560 35694 0 1 0 187 5 0 0 22 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1629] ppid=1624 vsize=15704868 CPUtime=0.21 cores=0,2,4,6
/proc/1626/task/1629/stat : 1629 (java) S 1624 1626 802 0 -1 4202560 45997 0 0 0 14 7 0 0 15 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1630] ppid=1624 vsize=15704868 CPUtime=0.08 cores=0,2,4,6
/proc/1626/task/1630/stat : 1630 (java) S 1624 1626 802 0 -1 4202560 25520 0 0 0 4 4 0 0 16 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1631] ppid=1624 vsize=15704868 CPUtime=0.06 cores=0,2,4,6
/proc/1626/task/1631/stat : 1631 (java) S 1624 1626 802 0 -1 4202560 14235 0 0 0 5 1 0 0 15 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1632] ppid=1624 vsize=15704868 CPUtime=0.2 cores=0,2,4,6
/proc/1626/task/1632/stat : 1632 (java) S 1624 1626 802 0 -1 4202560 34399 0 0 0 15 5 0 0 15 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1633] ppid=1624 vsize=15704868 CPUtime=0.11 cores=0,2,4,6
/proc/1626/task/1633/stat : 1633 (java) S 1624 1626 802 0 -1 4202560 22252 0 0 0 8 3 0 0 16 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1634] ppid=1624 vsize=15704868 CPUtime=0.16 cores=0,2,4,6
/proc/1626/task/1634/stat : 1634 (java) S 1624 1626 802 0 -1 4202560 30489 0 0 0 12 4 0 0 16 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1635] ppid=1624 vsize=15704868 CPUtime=0.17 cores=0,2,4,6
/proc/1626/task/1635/stat : 1635 (java) S 1624 1626 802 0 -1 4202560 33389 0 0 0 12 5 0 0 16 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1636] ppid=1624 vsize=15704868 CPUtime=0.23 cores=0,2,4,6
/proc/1626/task/1636/stat : 1636 (java) S 1624 1626 802 0 -1 4202560 42289 0 0 0 17 6 0 0 16 0 22 0 608630153 16081784832 455419 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=1626/tid=1638] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1638/stat : 1638 (java) S 1624 1626 802 0 -1 4202560 19 0 0 0 0 0 0 0 15 0 22 0 608630155 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) S 1624 1626 802 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608630155 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1640] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1640/stat : 1640 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427215281 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1641] ppid=1624 vsize=15704868 CPUtime=0.97 cores=0,2,4,6
/proc/1626/task/1641/stat : 1641 (java) S 1624 1626 802 0 -1 4202560 8176 0 0 0 97 0 0 0 15 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1642] ppid=1624 vsize=15704868 CPUtime=1.11 cores=0,2,4,6
/proc/1626/task/1642/stat : 1642 (java) S 1624 1626 802 0 -1 4202560 4982 0 0 0 111 0 0 0 15 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1643] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1643/stat : 1643 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1644] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1644/stat : 1644 (java) S 1624 1626 802 0 -1 4202560 61 0 0 0 0 0 0 0 15 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1649] ppid=1624 vsize=15704868 CPUtime=128.32 cores=0,2,4,6
/proc/1626/task/1649/stat : 1649 (java) S 1624 1626 802 0 -1 4202560 121859 0 0 0 12814 18 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1650] ppid=1624 vsize=15704868 CPUtime=128.1 cores=0,2,4,6
/proc/1626/task/1650/stat : 1650 (java) S 1624 1626 802 0 -1 4202560 110355 0 0 0 12794 16 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1651] ppid=1624 vsize=15704868 CPUtime=128.33 cores=0,2,4,6
/proc/1626/task/1651/stat : 1651 (java) S 1624 1626 802 0 -1 4202560 107791 0 0 0 12818 15 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1652] ppid=1624 vsize=15704868 CPUtime=127.8 cores=0,2,4,6
/proc/1626/task/1652/stat : 1652 (java) S 1624 1626 802 0 -1 4202560 116811 0 0 0 12757 23 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1583.61
Current children cumulated vsize (KiB) 15704868

[startup+1242.3 s]
/proc/loadavg: 3.29 4.67 5.68 2/193 1708
/proc/meminfo: memFree=14278144/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15704868 CPUtime=1644.67 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 3900070 0 1 0 163767 700 0 0 25 0 22 0 608630152 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3926217 3845962 2294 9 0 3916936 0
[pid=1626/tid=1627] ppid=1624 vsize=15704868 CPUtime=1.92 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) S 1624 1626 802 0 -1 4202560 35694 0 1 0 187 5 0 0 22 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1629] ppid=1624 vsize=15704868 CPUtime=2.88 cores=0,2,4,6
/proc/1626/task/1629/stat : 1629 (java) S 1624 1626 802 0 -1 4202560 366659 0 0 0 222 66 0 0 16 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1630] ppid=1624 vsize=15704868 CPUtime=3.21 cores=0,2,4,6
/proc/1626/task/1630/stat : 1630 (java) S 1624 1626 802 0 -1 4202560 426761 0 0 0 246 75 0 0 16 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1631] ppid=1624 vsize=15704868 CPUtime=2.21 cores=0,2,4,6
/proc/1626/task/1631/stat : 1631 (java) S 1624 1626 802 0 -1 4202560 312364 0 0 0 165 56 0 0 16 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1632] ppid=1624 vsize=15704868 CPUtime=2.21 cores=0,2,4,6
/proc/1626/task/1632/stat : 1632 (java) S 1624 1626 802 0 -1 4202560 262013 0 0 0 174 47 0 0 15 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1633] ppid=1624 vsize=15704868 CPUtime=2.45 cores=0,2,4,6
/proc/1626/task/1633/stat : 1633 (java) S 1624 1626 802 0 -1 4202560 374734 0 0 0 178 67 0 0 16 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1634] ppid=1624 vsize=15704868 CPUtime=2.71 cores=0,2,4,6
/proc/1626/task/1634/stat : 1634 (java) S 1624 1626 802 0 -1 4202560 324651 0 0 0 214 57 0 0 16 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1635] ppid=1624 vsize=15704868 CPUtime=2.39 cores=0,2,4,6
/proc/1626/task/1635/stat : 1635 (java) S 1624 1626 802 0 -1 4202560 308862 0 0 0 181 58 0 0 15 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1636] ppid=1624 vsize=15704868 CPUtime=3.06 cores=0,2,4,6
/proc/1626/task/1636/stat : 1636 (java) S 1624 1626 802 0 -1 4202560 386052 0 0 0 236 70 0 0 16 0 22 0 608630153 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1637] ppid=1624 vsize=15704868 CPUtime=1105.38 cores=0,2,4,6
/proc/1626/task/1637/stat : 1637 (java) R 1624 1626 802 0 -1 4202560 630222 0 0 0 110422 116 0 0 18 0 22 0 608630154 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 47305547016000 0 0 0 16800975 0 0 0 -1 2 0 0 0
[pid=1626/tid=1638] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1638/stat : 1638 (java) S 1624 1626 802 0 -1 4202560 19 0 0 0 0 0 0 0 15 0 22 0 608630155 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) S 1624 1626 802 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608630155 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1640] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1640/stat : 1640 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427215281 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1641] ppid=1624 vsize=15704868 CPUtime=0.97 cores=0,2,4,6
/proc/1626/task/1641/stat : 1641 (java) S 1624 1626 802 0 -1 4202560 8176 0 0 0 97 0 0 0 15 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1642] ppid=1624 vsize=15704868 CPUtime=1.11 cores=0,2,4,6
/proc/1626/task/1642/stat : 1642 (java) S 1624 1626 802 0 -1 4202560 4982 0 0 0 111 0 0 0 15 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1643] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1643/stat : 1643 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1644] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1644/stat : 1644 (java) S 1624 1626 802 0 -1 4202560 64 0 0 0 0 0 0 0 15 0 22 0 608630157 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1649] ppid=1624 vsize=15704868 CPUtime=128.7 cores=0,2,4,6
/proc/1626/task/1649/stat : 1649 (java) S 1624 1626 802 0 -1 4202560 122002 0 0 0 12851 19 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1650] ppid=1624 vsize=15704868 CPUtime=128.46 cores=0,2,4,6
/proc/1626/task/1650/stat : 1650 (java) S 1624 1626 802 0 -1 4202560 110638 0 0 0 12830 16 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1651] ppid=1624 vsize=15704868 CPUtime=128.69 cores=0,2,4,6
/proc/1626/task/1651/stat : 1651 (java) S 1624 1626 802 0 -1 4202560 107889 0 0 0 12853 16 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1652] ppid=1624 vsize=15704868 CPUtime=128.17 cores=0,2,4,6
/proc/1626/task/1652/stat : 1652 (java) S 1624 1626 802 0 -1 4202560 116920 0 0 0 12793 24 0 0 15 0 22 0 608630228 16081784832 3845962 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1644.67
Current children cumulated vsize (KiB) 15704868



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.84 4.00 5.38 2/192 1710
/proc/meminfo: memFree=14277852/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=15704868 CPUtime=1702.83 cores=0,2,4,6
/proc/1626/stat : 1626 (java) S 1624 1626 802 0 -1 4202496 3900775 0 1 0 169565 718 0 0 25 0 21 0 608630152 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 3926217 3845963 2295 9 0 3916936 0
[pid=1626/tid=1627] ppid=1624 vsize=15704868 CPUtime=1.92 cores=0,2,4,6
/proc/1626/task/1627/stat : 1627 (java) S 1624 1626 802 0 -1 4202560 35694 0 1 0 187 5 0 0 22 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1629] ppid=1624 vsize=15704868 CPUtime=2.88 cores=0,2,4,6
/proc/1626/task/1629/stat : 1629 (java) S 1624 1626 802 0 -1 4202560 366659 0 0 0 222 66 0 0 16 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1630] ppid=1624 vsize=15704868 CPUtime=3.21 cores=0,2,4,6
/proc/1626/task/1630/stat : 1630 (java) S 1624 1626 802 0 -1 4202560 426761 0 0 0 246 75 0 0 16 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1631] ppid=1624 vsize=15704868 CPUtime=2.21 cores=0,2,4,6
/proc/1626/task/1631/stat : 1631 (java) S 1624 1626 802 0 -1 4202560 312364 0 0 0 165 56 0 0 16 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1632] ppid=1624 vsize=15704868 CPUtime=2.21 cores=0,2,4,6
/proc/1626/task/1632/stat : 1632 (java) S 1624 1626 802 0 -1 4202560 262013 0 0 0 174 47 0 0 15 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1633] ppid=1624 vsize=15704868 CPUtime=2.45 cores=0,2,4,6
/proc/1626/task/1633/stat : 1633 (java) S 1624 1626 802 0 -1 4202560 374734 0 0 0 178 67 0 0 16 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1634] ppid=1624 vsize=15704868 CPUtime=2.71 cores=0,2,4,6
/proc/1626/task/1634/stat : 1634 (java) S 1624 1626 802 0 -1 4202560 324651 0 0 0 214 57 0 0 16 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1635] ppid=1624 vsize=15704868 CPUtime=2.39 cores=0,2,4,6
/proc/1626/task/1635/stat : 1635 (java) S 1624 1626 802 0 -1 4202560 308862 0 0 0 181 58 0 0 15 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1636] ppid=1624 vsize=15704868 CPUtime=3.06 cores=0,2,4,6
/proc/1626/task/1636/stat : 1636 (java) S 1624 1626 802 0 -1 4202560 386052 0 0 0 236 70 0 0 16 0 21 0 608630153 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1637] ppid=1624 vsize=15704868 CPUtime=1162.79 cores=0,2,4,6
/proc/1626/task/1637/stat : 1637 (java) R 1624 1626 802 0 -1 4202560 630226 0 0 0 116146 133 0 0 25 0 21 0 608630154 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 47305548607862 0 0 0 16800975 0 0 0 -1 0 0 0 0
[pid=1626/tid=1638] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1638/stat : 1638 (java) S 1624 1626 802 0 -1 4202560 19 0 0 0 0 0 0 0 15 0 21 0 608630155 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) S 1624 1626 802 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 21 0 608630155 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1640] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1640/stat : 1640 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 608630157 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427215281 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1641] ppid=1624 vsize=15704868 CPUtime=0.97 cores=0,2,4,6
/proc/1626/task/1641/stat : 1641 (java) S 1624 1626 802 0 -1 4202560 8176 0 0 0 97 0 0 0 15 0 21 0 608630157 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
[pid=1626/tid=1642] ppid=1624 vsize=15704868 CPUtime=1.11 cores=0,2,4,6
/proc/1626/task/1642/stat : 1642 (java) S 1624 1626 802 0 -1 4202560 4982 0 0 0 111 0 0 0 15 0 21 0 608630157 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 6 0 0 0
[pid=1626/tid=1643] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1643/stat : 1643 (java) S 1624 1626 802 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 608630157 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1644] ppid=1624 vsize=15704868 CPUtime=0 cores=0,2,4,6
/proc/1626/task/1644/stat : 1644 (java) S 1624 1626 802 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 21 0 608630157 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427208192 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1649] ppid=1624 vsize=15704868 CPUtime=128.94 cores=0,2,4,6
/proc/1626/task/1649/stat : 1649 (java) S 1624 1626 802 0 -1 4202560 122424 0 0 0 12875 19 0 0 15 0 21 0 608630228 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 0 0 0 0
[pid=1626/tid=1650] ppid=1624 vsize=15704868 CPUtime=128.69 cores=0,2,4,6
/proc/1626/task/1650/stat : 1650 (java) S 1624 1626 802 0 -1 4202560 110757 0 0 0 12853 16 0 0 15 0 21 0 608630228 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 4 0 0 0
[pid=1626/tid=1652] ppid=1624 vsize=15704868 CPUtime=128.42 cores=0,2,4,6
/proc/1626/task/1652/stat : 1652 (java) S 1624 1626 802 0 -1 4202560 117073 0 0 0 12818 24 0 0 15 0 21 0 608630228 16081784832 3845963 33554432000 1073741824 1073778376 140734999774048 18446744073709551615 256427207577 0 4 0 16800975 18446604453889238144 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1702.83
Current children cumulated vsize (KiB) 15704868

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -1626

[startup+1302.3 s]
/proc/loadavg: 1.84 4.00 5.38 2/193 1711
/proc/meminfo: memFree=14277968/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=0 CPUtime=1705.13 cores=0,2,4,6
/proc/1626/stat : 1626 (java) Z 1624 1626 802 0 -1 4203548 3900805 0 1 0 169767 746 0 0 18 0 2 0 608630152 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 0 0 0 0 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=0 CPUtime=0.28 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) R 1624 1626 802 0 -1 4203588 8 0 0 0 0 28 0 0 18 0 2 0 608630155 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1705.13
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.51 s]
/proc/loadavg: 1.84 4.00 5.38 2/173 1711
/proc/meminfo: memFree=24881120/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=0 CPUtime=1705.33 cores=0,2,4,6
/proc/1626/stat : 1626 (java) Z 1624 1626 802 0 -1 4203548 3900805 0 1 0 169767 766 0 0 18 0 2 0 608630152 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 0 0 0 0 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=0 CPUtime=0.48 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) R 1624 1626 802 0 -1 4203588 8 0 0 0 0 48 0 0 18 0 2 0 608630155 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1705.33
Current children cumulated vsize (KiB) 0

[startup+1302.6 s]
/proc/loadavg: 1.84 4.00 5.38 2/173 1711
/proc/meminfo: memFree=24881120/32950928 swapFree=67111364/67111528
[pid=1626] ppid=1624 vsize=0 CPUtime=1705.43 cores=0,2,4,6
/proc/1626/stat : 1626 (java) Z 1624 1626 802 0 -1 4203548 3900805 0 1 0 169767 776 0 0 18 0 2 0 608630152 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/1626/statm: 0 0 0 0 0 0 0
[pid=1626/tid=1639] ppid=1624 vsize=0 CPUtime=0.57 cores=0,2,4,6
/proc/1626/task/1639/stat : 1639 (java) R 1624 1626 802 0 -1 4203588 8 0 0 0 0 57 0 0 18 0 2 0 608630155 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1705.43
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.62
CPU time (s): 1705.45
CPU user time (s): 1697.67
CPU system time (s): 7.78282
CPU usage (%): 130.925
Max. virtual memory (cumulated for all children) (KiB): 15705444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1697.67
system time used= 7.78282
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3900805
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 75526
involuntary context switches= 33171

runsolver used 1.9937 second user time and 5.18421 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-30 19:19:55
IDJOB=3311772
IDBENCH=83198
IDSOLVER=1698
FILE ID=node115/3311772-1304183995
RUNJOBID= node115-1304182785-1446
PBS_JOBID= 13172447
Free space on /tmp= 72876 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1520_u.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311772-1304183995/watcher-3311772-1304183995 -o /tmp/evaluation-result-3311772-1304183995/solver-3311772-1304183995 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311772-1304183995.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac02a3a5c06227748ecf75dd451ebb7e
RANDOM SEED=721143900

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29663432 kB
Buffers:        851296 kB
Cached:        1927136 kB
SwapCached:          0 kB
Active:         277500 kB
Inactive:      2585380 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29663432 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            5924 kB
Writeback:           0 kB
AnonPages:       84768 kB
Mapped:          23232 kB
Slab:           361428 kB
PageTables:       4668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   778640 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72876 MiB
End job on node115 at 2011-04-30 19:41:38