Trace number 249156

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.08 1816.02

General information on the benchmark

Nameprimes/primes-15/
primes-15-60-3-5.xml
MD5SUMa6c63105dd9b62ba32a6970ebe963998
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark20.012
SatisfiableYES
(Un)Satisfiability was proved
Number of variables100
Number of constraints60
Maximum constraint arity8
Maximum domain size46
Number of constraints which are defined in extension0
Number of constraints which are defined in intension60
Global constraints used (with number of constraints)

Solver Data (download as text)

0.32	   
0.32	Abscon 109 (November, 2006)
0.32	   
0.32	   configuration
0.32	     name=mac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/249156-1168086091/unknown.xml
0.38	   
0.38	   domains being loaded...
0.38	   
0.38	   variables being loaded...
0.43	     nbVariables=100  nbDomainTypes=1  minDomainSize=46  maxDomainSize=46
0.43	       =>  wckTime=0.112  cpuTime=0.09  mem=6M951
0.43	   
0.43	   predicates being loaded...
0.48	   
0.48	   constraints being loaded...
0.85	     nbConstraints=60  nbSingletonDomainVariables=1  nbDisconnectedVariables=1  nbConflictsStructures=5
0.85	     nbSharedConflictsStructures=0  nbUnbuiltConflictsStructures=55  nbSharedBinaryRepresentations=0
0.85	     nbEvaluationManagers=60  nbSharedEvaluationManagers=0  maxDegree=8  maxArity=8
0.85	       =>  wckTime=0.528  cpuTime=0.43  mem=10M869
0.89	   
0.89	   solver IterativeSystematicSolver being built... 
1.06	       =>  wckTime=0.738  cpuTime=0.57  mem=15M601
1.26	   
1.26	   preprocessing
1.26	     nbConstraintChecks=418027  nbValidityChecks=291  nbPropagations=105  nbRevisions=21  nbUselessRevisions=3
1.26	     nbRemovedValues=236  detectedInconsistency=no
1.26	       =>  wckTime=0.195  cpuTime=0.18  mem=15M601
1.84	   
1.84	   search
1.84	     run=0  nbConstraintChecks=891282  nbValidityChecks=1026  nbPropagations=187  nbRevisions=103  nbUselessRevisions=28
1.84	     nbAssignments=25  nbFailedAssignments=11  nbBacktracks=10  nbVisitedNodes=37  nbRestartNogoods=0  mapSize=4
1.84	     nbInferences=0  nbTooLargeKeys=0
1.84	       =>  wckTime=0.78  cpuTime=0.74  mem=15M601
3.48	   
3.48	   search
3.48	     run=1  nbConstraintChecks=3310565  nbValidityChecks=4532  nbPropagations=582  nbRevisions=456
3.48	     nbUselessRevisions=138  nbAssignments=68  nbFailedAssignments=15  nbBacktracks=40  nbVisitedNodes=84
3.48	     nbRestartNogoods=2  mapSize=25  nbInferences=0  nbTooLargeKeys=0
3.48	       =>  wckTime=2.424  cpuTime=2.36  mem=15M601
5.03	   
5.03	   search
5.03	     run=2  nbConstraintChecks=5588575  nbValidityChecks=10500  nbPropagations=1358  nbRevisions=1247
5.03	     nbUselessRevisions=355  nbAssignments=125  nbFailedAssignments=22  nbBacktracks=63  nbVisitedNodes=148
5.03	     nbRestartNogoods=4  mapSize=41  nbInferences=0  nbTooLargeKeys=0
5.03	       =>  wckTime=3.971  cpuTime=3.89  mem=15M601
6.48	   
6.48	   search
6.48	     run=3  nbConstraintChecks=7794165  nbValidityChecks=15060  nbPropagations=2410  nbRevisions=2378
6.48	     nbUselessRevisions=679  nbAssignments=183  nbFailedAssignments=32  nbBacktracks=103  nbVisitedNodes=216
6.48	     nbRestartNogoods=8  mapSize=67  nbInferences=0  nbTooLargeKeys=0
6.48	       =>  wckTime=5.421  cpuTime=5.33  mem=15M601
8.81	   
8.81	   search
8.81	     run=4  nbConstraintChecks=11216497  nbValidityChecks=21718  nbPropagations=3855  nbRevisions=3983
8.81	     nbUselessRevisions=1152  nbAssignments=262  nbFailedAssignments=47  nbBacktracks=158  nbVisitedNodes=310
8.81	     nbRestartNogoods=10  mapSize=102  nbInferences=0  nbTooLargeKeys=0
8.81	       =>  wckTime=7.745  cpuTime=7.62  mem=15M601
12.99	   
12.99	   search
12.99	     run=5  nbConstraintChecks=17508334  nbValidityChecks=36462  nbPropagations=6098  nbRevisions=6650
12.99	     nbUselessRevisions=1923  nbAssignments=408  nbFailedAssignments=97  nbBacktracks=236  nbVisitedNodes=506
12.99	     nbRestartNogoods=15  mapSize=158  nbInferences=0  nbTooLargeKeys=0
12.99	       =>  wckTime=11.927  cpuTime=11.76  mem=16M576
18.33	   
18.33	   search
18.33	     run=6  nbConstraintChecks=24507067  nbValidityChecks=54036  nbPropagations=9316  nbRevisions=10488
18.33	     nbUselessRevisions=3054  nbAssignments=589  nbFailedAssignments=134  nbBacktracks=349  nbVisitedNodes=724
18.33	     nbRestartNogoods=24  mapSize=243  nbInferences=0  nbTooLargeKeys=0
18.33	       =>  wckTime=17.27  cpuTime=17.04  mem=16M576
29.25	   
29.25	   search
29.25	     run=7  nbConstraintChecks=39721785  nbValidityChecks=91483  nbPropagations=14275  nbRevisions=16482
29.25	     nbUselessRevisions=4795  nbAssignments=871  nbFailedAssignments=211  nbBacktracks=520  nbVisitedNodes=1083
29.25	     nbRestartNogoods=27  mapSize=384  nbInferences=0  nbTooLargeKeys=0
29.25	       =>  wckTime=28.186  cpuTime=27.86  mem=16M576
41.56	   
41.56	   search
41.56	     run=8  nbConstraintChecks=56333505  nbValidityChecks=137669  nbPropagations=21589  nbRevisions=25405
41.56	     nbUselessRevisions=7318  nbAssignments=1280  nbFailedAssignments=344  nbBacktracks=776  nbVisitedNodes=1625
41.56	     nbRestartNogoods=40  mapSize=557  nbInferences=0  nbTooLargeKeys=0
41.56	       =>  wckTime=40.5  cpuTime=40.06  mem=16M576
53.96	   
53.97	   search
53.97	     run=9  nbConstraintChecks=74721900  nbValidityChecks=196361  nbPropagations=31671  nbRevisions=38135
53.97	     nbUselessRevisions=10985  nbAssignments=1830  nbFailedAssignments=488  nbBacktracks=1161  nbVisitedNodes=2319
53.97	     nbRestartNogoods=48  mapSize=764  nbInferences=0  nbTooLargeKeys=0
53.97	       =>  wckTime=52.905  cpuTime=52.34  mem=16M576
73.86	   
73.86	   INFO : Stopping hyperNogood (mapSize=1024, nbTooLargekeys=0, mem=16M576)
81.75	   
81.75	   search
81.75	     run=10  nbConstraintChecks=113085199  nbValidityChecks=292375  nbPropagations=46350  nbRevisions=56597
81.75	     nbUselessRevisions=16323  nbAssignments=2706  nbFailedAssignments=768  nbBacktracks=1740  nbVisitedNodes=3475
81.75	     nbRestartNogoods=56
81.75	       =>  wckTime=80.691  cpuTime=79.85  mem=16M576
121.10	   
121.10	   search
121.10	     run=11  nbConstraintChecks=170558980  nbValidityChecks=449249  nbPropagations=68178  nbRevisions=83678
121.10	     nbUselessRevisions=24081  nbAssignments=3907  nbFailedAssignments=1081  nbBacktracks=2608  nbVisitedNodes=4989
121.10	     nbRestartNogoods=61
121.10	       =>  wckTime=120.045  cpuTime=118.84  mem=16M576
177.41	   
177.41	   search
177.41	     run=12  nbConstraintChecks=249866426  nbValidityChecks=672161  nbPropagations=99895  nbRevisions=123519
177.41	     nbUselessRevisions=35553  nbAssignments=5707  nbFailedAssignments=1557  nbBacktracks=3908  nbVisitedNodes=7265
177.41	     nbRestartNogoods=72
177.41	       =>  wckTime=176.348  cpuTime=174.63  mem=16M576
261.12	   
261.12	   search
261.12	     run=13  nbConstraintChecks=365119044  nbValidityChecks=1003899  nbPropagations=145837  nbRevisions=181751
261.12	     nbUselessRevisions=52453  nbAssignments=8361  nbFailedAssignments=2239  nbBacktracks=5858  nbVisitedNodes=10601
261.12	     nbRestartNogoods=80
261.12	       =>  wckTime=260.058  cpuTime=257.57  mem=16M576
378.38	   
378.38	   search
378.38	     run=14  nbConstraintChecks=532222488  nbValidityChecks=1498622  nbPropagations=215860  nbRevisions=269190
378.38	     nbUselessRevisions=77262  nbAssignments=12516  nbFailedAssignments=3448  nbBacktracks=8783  nbVisitedNodes=15965
378.38	     nbRestartNogoods=95
378.38	       =>  wckTime=377.319  cpuTime=373.75  mem=16M576
598.72	   
598.72	   search
598.72	     run=15  nbConstraintChecks=867291065  nbValidityChecks=2385343  nbPropagations=331027  nbRevisions=411165
598.72	     nbUselessRevisions=116321  nbAssignments=19689  nbFailedAssignments=6226  nbBacktracks=13162  nbVisitedNodes=25916
598.72	     nbRestartNogoods=102
598.72	       =>  wckTime=597.658  cpuTime=592.05  mem=16M576
908.45	   
908.45	   search
908.45	     run=16  nbConstraintChecks=1309998594  nbValidityChecks=3576454  nbPropagations=500039  nbRevisions=618282
908.45	     nbUselessRevisions=173267  nbAssignments=29083  nbFailedAssignments=9029  nbBacktracks=19731  nbVisitedNodes=38119
908.45	     nbRestartNogoods=128
908.45	       =>  wckTime=907.393  cpuTime=898.95  mem=16M576
1439.47	   
1439.47	   search
1439.47	     run=17  nbConstraintChecks=2009844828  nbValidityChecks=5876969  nbPropagations=779083  nbRevisions=953427
1439.47	     nbUselessRevisions=257942  nbAssignments=43824  nbFailedAssignments=13897  nbBacktracks=29583  nbVisitedNodes=57728
1439.47	     nbRestartNogoods=135
1439.47	       =>  wckTime=1438.41  cpuTime=1425.09  mem=16M576

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node19/watcher-249156-1168086091 -o ROOT/results/node19/solver-249156-1168086091 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/249156-1168086091/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.12 0.70 0.97 2/93 26932
/proc/meminfo: memFree=1187128/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=18540 CPUtime=0
/proc/26931/stat : 26931 (runsolver) R 26929 26931 26646 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 157004236 18984960 279 18446744073709551615 4194304 4267372 548682068944 18446744073709551615 255236566311 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/26931/statm: 4635 279 244 17 0 2626 0

[startup+0.10243 s]
/proc/loadavg: 1.12 0.70 0.97 2/93 26932
/proc/meminfo: memFree=1187128/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=914988 CPUtime=0.08
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 2965 0 1 0 7 1 0 0 17 0 8 0 157004236 936947712 2711 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4072897015 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228747 2711 1417 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.514507 s]
/proc/loadavg: 1.12 0.70 0.97 2/93 26932
/proc/meminfo: memFree=1187128/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915328 CPUtime=0.48
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 6756 0 1 0 44 4 0 0 18 0 8 0 157004236 937295872 6495 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4153440225 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228832 6495 2145 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33866 s]
/proc/loadavg: 1.12 0.70 0.97 3/100 26939
/proc/meminfo: memFree=1163008/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1.28
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 8854 0 1 0 122 6 0 0 25 0 8 0 157004236 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8592 2529 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 180 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.18
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 355 0 0 0 17 1 0 0 16 0 8 0 157004244 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 915464

[startup+2.97596 s]
/proc/loadavg: 1.12 0.70 0.97 3/100 26939
/proc/meminfo: memFree=1162432/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=2.92
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 8886 0 1 0 285 7 0 0 25 0 8 0 157004236 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073626756 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8622 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 17 0 8 0 157004240 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.2
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 367 0 0 0 19 1 0 0 15 0 8 0 157004244 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8622 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.92
Current children cumulated vsize (KiB) 915464

[startup+6.27558 s]
/proc/loadavg: 1.19 0.72 0.98 3/100 26939
/proc/meminfo: memFree=1162368/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=6.18
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 8902 0 1 0 611 7 0 0 25 0 8 0 157004236 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8636 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.2
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 369 0 0 0 19 1 0 0 15 0 8 0 157004244 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8636 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 915464

[startup+12.7518 s]
/proc/loadavg: 1.25 0.74 0.98 3/100 26939
/proc/meminfo: memFree=1162304/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=12.6
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 8931 0 1 0 1253 7 0 0 25 0 8 0 157004236 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073627514 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8661 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 17 0 8 0 157004240 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.21
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 379 0 0 0 20 1 0 0 15 0 8 0 157004244 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8661 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 915464

[startup+25.6072 s]
/proc/loadavg: 1.42 0.80 1.00 3/100 26939
/proc/meminfo: memFree=1162176/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=25.33
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 8967 0 1 0 2526 7 0 0 25 0 8 0 157004236 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073629304 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8695 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.22
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 382 0 0 0 21 1 0 0 16 0 8 0 157004244 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8695 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.33
Current children cumulated vsize (KiB) 915464

[startup+51.215 s]
/proc/loadavg: 1.61 0.90 1.02 3/100 26939
/proc/meminfo: memFree=1161920/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=50.71
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9047 0 1 0 5063 8 0 0 25 0 8 0 157004236 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073622931 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8769 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.24
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 391 0 0 0 23 1 0 0 15 0 8 0 157004244 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8769 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 915464

[startup+102.416 s]
/proc/loadavg: 1.83 1.07 1.07 3/100 26939
/proc/meminfo: memFree=1161600/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=101.43
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9112 0 1 0 10135 8 0 0 25 0 8 0 157004236 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073622954 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8831 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.25
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 399 0 0 0 24 1 0 0 17 0 8 0 157004244 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8831 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 915464

[startup+162.455 s]
/proc/loadavg: 1.94 1.23 1.13 3/100 26939
/proc/meminfo: memFree=1161600/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=160.93
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9117 0 1 0 16084 9 0 0 25 0 8 0 157004236 937435136 8835 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073622963 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1410.29
Current children cumulated vsize (KiB) 915464

[startup+1483.45 s]
/proc/loadavg: 2.05 2.01 1.77 3/100 26939
/proc/meminfo: memFree=1160768/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1469.79
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 146961 18 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073621109 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1469.79
Current children cumulated vsize (KiB) 915464

[startup+1543.48 s]
/proc/loadavg: 2.02 2.01 1.78 3/100 26939
/proc/meminfo: memFree=1160768/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1529.27
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 152909 18 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073631927 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1529.27
Current children cumulated vsize (KiB) 915464

[startup+1603.52 s]
/proc/loadavg: 2.00 2.00 1.79 3/100 26939
/proc/meminfo: memFree=1160704/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1588.76
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 158858 18 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073625972 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1588.76
Current children cumulated vsize (KiB) 915464

[startup+1663.58 s]
/proc/loadavg: 2.06 2.01 1.81 3/100 26939
/proc/meminfo: memFree=1160704/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1648.27
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 164808 19 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073622869 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1648.27
Current children cumulated vsize (KiB) 915464

[startup+1723.63 s]
/proc/loadavg: 1.94 1.99 1.82 2/88 26986
/proc/meminfo: memFree=1190240/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1707.8
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 170760 20 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073622878 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1707.8
Current children cumulated vsize (KiB) 915464

[startup+1783.64 s]
/proc/loadavg: 1.99 1.99 1.82 3/93 27012
/proc/meminfo: memFree=940600/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1767.73
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 176752 21 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073625904 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1767.73
Current children cumulated vsize (KiB) 915464



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1815.96 s]
/proc/loadavg: 1.99 1.99 1.83 3/93 27012
/proc/meminfo: memFree=939768/2055920 swapFree=4171232/4192956
[pid=26931] ppid=26929 vsize=915464 CPUtime=1800.02
/proc/26931/stat : 26931 (java) R 26929 26931 26646 0 -1 0 9138 0 1 0 179981 21 0 0 25 0 8 0 157004236 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073631485 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/26931/statm: 228866 8854 2533 14 0 215336 0
[pid=26931/tid=26933] ppid=26929 vsize=915464 CPUtime=0.02
/proc/26931/task/26933/stat : 26933 (java) S 26929 26931 26646 0 -1 64 181 0 0 0 2 0 0 0 16 0 8 0 157004240 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26934] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26934/stat : 26934 (java) S 26929 26931 26646 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26935] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26935/stat : 26935 (java) S 26929 26931 26646 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 157004241 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26936] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26936/stat : 26936 (java) S 26929 26931 26646 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26937] ppid=26929 vsize=915464 CPUtime=0.26
/proc/26931/task/26937/stat : 26937 (java) S 26929 26931 26646 0 -1 64 404 0 0 0 25 1 0 0 16 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26938] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26938/stat : 26938 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26931/tid=26939] ppid=26929 vsize=915464 CPUtime=0
/proc/26931/task/26939/stat : 26939 (java) S 26929 26931 26646 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 157004244 937435136 8854 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 915464

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1816.02
CPU time (s): 1800.08
CPU user time (s): 1799.86
CPU system time (s): 0.218966
CPU usage (%): 99.1224
Max. virtual memory (cumulated for all children) (KiB): 915464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.86
system time used= 0.218966
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9157
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37903
involuntary context switches= 72626

runsolver used 1.9707 s user time and 6.06908 s system time

The end

Launcher Data (download as text)

Begin job on node19 on Sat Jan  6 12:21:33 UTC 2007


IDJOB= 249156
IDBENCH= 11762
FILE ID= node19/249156-1168086091

PBS_JOBID= 3476339

Free space on /tmp= 66310 MiB

BENCH NAME= HOME/pub/bench/CPAI06/primes/primes-15/primes-15-60-3-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/249156-1168086091/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node19/watcher-249156-1168086091 -o ROOT/results/node19/solver-249156-1168086091 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/249156-1168086091/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  a6c63105dd9b62ba32a6970ebe963998

RANDOM SEED= 764388310

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.260
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.260
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1187608 kB
Buffers:         70348 kB
Cached:         634908 kB
SwapCached:      10036 kB
Active:         334924 kB
Inactive:       432392 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1187608 kB
SwapTotal:     4192956 kB
SwapFree:      4171232 kB
Dirty:            1868 kB
Writeback:           0 kB
Mapped:          81416 kB
Slab:            85436 kB
Committed_AS:  4504620 kB
PageTables:       2480 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66310 MiB



End job on node19 on Sat Jan  6 12:51:52 UTC 2007