Trace number 248817

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.14 1812.44

General information on the benchmark

Nameprimes/primes-25/
primes-25-40-3-5.xml
MD5SUMecdf56a5d6ac73aa5328c124b08f36c3
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints40
Maximum constraint arity8
Maximum domain size96
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/248817-1168401385/unknown.xml
0.38	   
0.38	   domains being loaded...
0.38	   
0.38	   variables being loaded...
0.43	     nbVariables=100  nbDomainTypes=1  minDomainSize=96  maxDomainSize=96
0.43	       =>  wckTime=0.113  cpuTime=0.09  mem=7M927
0.43	   
0.43	   predicates being loaded...
0.46	   
0.46	   constraints being loaded...
0.56	     nbConstraints=40  nbSingletonDomainVariables=9  nbDisconnectedVariables=9  nbUnbuiltConflictsStructures=40
0.56	     nbSharedBinaryRepresentations=0  nbEvaluationManagers=40  nbSharedEvaluationManagers=0  maxDegree=6  maxArity=8
0.56	       =>  wckTime=0.242  cpuTime=0.18  mem=9M877
0.59	   
0.59	   solver IterativeSystematicSolver being built... 
0.77	       =>  wckTime=0.459  cpuTime=0.33  mem=16M524
42.62	   
42.62	   INFO : Stopping ESAC
42.62	   
42.62	   preprocessing
42.62	     nbConstraintChecks=68694373  nbValidityChecks=8580  nbPropagations=498  nbRevisions=297  nbUselessRevisions=66
42.62	     nbSingletonTests=180  nbEffectiveSingletonTests=41  nbESACBranches=7  nbRemovedValues=586  detectedInconsistency=no
42.62	       =>  wckTime=41.843  cpuTime=41.42  mem=16M524
69.38	   
69.38	   search
69.38	     run=0  nbConstraintChecks=39045310  nbValidityChecks=9894  nbPropagations=705  nbRevisions=538
69.38	     nbUselessRevisions=116  nbAssignments=58  nbFailedAssignments=29  nbBacktracks=10  nbVisitedNodes=88
69.38	     nbRestartNogoods=0  mapSize=10  nbInferences=0  nbTooLargeKeys=0
69.38	       =>  wckTime=68.605  cpuTime=67.92  mem=16M524
560.41	   
560.42	   search
560.42	     run=1  nbConstraintChecks=742083981  nbValidityChecks=81485  nbPropagations=3275  nbRevisions=2090
560.42	     nbUselessRevisions=257  nbAssignments=949  nbFailedAssignments=797  nbBacktracks=25  nbVisitedNodes=1642
560.42	     nbRestartNogoods=18  mapSize=18  nbInferences=0  nbTooLargeKeys=0
560.42	       =>  wckTime=559.639  cpuTime=554.16  mem=16M524
1250.12	   
1250.12	   search
1250.12	     run=2  nbConstraintChecks=1718714710  nbValidityChecks=184106  nbPropagations=8313  nbRevisions=5063
1250.12	     nbUselessRevisions=478  nbAssignments=2089  nbFailedAssignments=1881  nbBacktracks=48  nbVisitedNodes=3866
1250.12	     nbRestartNogoods=25  mapSize=39  nbInferences=0  nbTooLargeKeys=0
1250.12	       =>  wckTime=1249.343  cpuTime=1237.6  mem=16M524
1384.52	   
1384.52	   search
1384.52	     run=3  nbConstraintChecks=1935631105  nbValidityChecks=246484  nbPropagations=15168  nbRevisions=9812
1384.52	     nbUselessRevisions=1109  nbAssignments=2632  nbFailedAssignments=2041  nbBacktracks=81  nbVisitedNodes=4245
1384.52	     nbRestartNogoods=52  mapSize=68  nbInferences=0  nbTooLargeKeys=0
1384.52	       =>  wckTime=1383.741  cpuTime=1371.85  mem=16M524
1724.22	   
1724.22	   search
1724.22	     run=4  nbConstraintChecks=2408831556  nbValidityChecks=366226  nbPropagations=24896  nbRevisions=17333
1724.22	     nbUselessRevisions=2146  nbAssignments=3425  nbFailedAssignments=2417  nbBacktracks=131  nbVisitedNodes=5074
1724.22	     nbRestartNogoods=164  mapSize=111  nbInferences=0  nbTooLargeKeys=0
1724.22	       =>  wckTime=1723.438  cpuTime=1711.14  mem=16M524

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node19/watcher-248817-1168401385 -o ROOT/results/node19/solver-248817-1168401385 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/248817-1168401385/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.91 1.97 1.99 4/94 29204
/proc/meminfo: memFree=1118152/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=18540 CPUtime=0
/proc/29203/stat : 29203 (runsolver) R 29201 29203 29136 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 188533147 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 255236566311 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/29203/statm: 4635 279 244 17 0 2626 0

[startup+0.108111 s]
/proc/loadavg: 1.91 1.97 1.99 4/94 29204
/proc/meminfo: memFree=1118152/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=914988 CPUtime=0.08
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 2996 0 1 0 7 1 0 0 18 0 8 0 188533147 936947712 2742 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072926602 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228747 2742 1427 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.517188 s]
/proc/loadavg: 1.91 1.97 1.99 4/94 29204
/proc/meminfo: memFree=1118152/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=0.49
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 6741 0 1 0 47 2 0 0 18 0 8 0 188533147 937435136 6480 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4152163392 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 6480 2163 14 0 215336 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 915464

[startup+1.33834 s]
/proc/loadavg: 1.91 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1093392/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1.3
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 8908 0 1 0 126 4 0 0 25 0 8 0 188533147 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073736192 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8646 2540 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.14
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 343 0 0 0 14 0 0 0 16 0 8 0 188533155 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8646 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915464

[startup+2.97564 s]
/proc/loadavg: 1.92 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1093392/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=2.93
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 8918 0 1 0 288 5 0 0 25 0 8 0 188533147 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073736864 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8654 2542 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 17 0 8 0 188533151 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.15
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 348 0 0 0 15 0 0 0 16 0 8 0 188533155 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8654 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915464

[startup+6.27327 s]
/proc/loadavg: 1.92 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1093264/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=6.2
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 8924 0 1 0 615 5 0 0 25 0 8 0 188533147 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073731588 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8658 2542 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 17 0 8 0 188533151 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.16
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 354 0 0 0 16 0 0 0 16 0 8 0 188533155 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8658 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 915464

[startup+12.7515 s]
/proc/loadavg: 1.93 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1093328/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=12.62
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 8930 0 1 0 1257 5 0 0 25 0 8 0 188533147 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073732647 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8662 2542 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.16
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 356 0 0 0 16 0 0 0 16 0 8 0 188533155 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8662 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 915464

[startup+25.6199 s]
/proc/loadavg: 1.94 1.97 1.99 4/101 29211
/proc/meminfo: memFree=1093456/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=25.37
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 8932 0 1 0 2532 5 0 0 25 0 8 0 188533147 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073733223 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8663 2542 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.16
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 357 0 0 0 16 0 0 0 16 0 8 0 188533155 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8663 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 915464

[startup+51.2367 s]
/proc/loadavg: 1.96 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1089424/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=50.75
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9035 0 1 0 5069 6 0 0 25 0 8 0 188533147 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073731368 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8764 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.18
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 365 0 0 0 17 1 0 0 17 0 8 0 188533155 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.75
Current children cumulated vsize (KiB) 915464

[startup+102.437 s]
/proc/loadavg: 1.98 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1089360/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=101.48
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9048 0 1 0 10142 6 0 0 25 0 8 0 188533147 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073731353 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/29203/statm: 228866 8773 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.19
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 369 0 0 0 18 1 0 0 16 0 8 0 188533155 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8773 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.48
Current children cumulated vsize (KiB) 915464

[startup+162.482 s]
/proc/loadavg: 1.99 1.97 1.99 3/101 29211
/proc/meminfo: memFree=1089296/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=160.96
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9053 0 1 0 16090 6 0 0 25 0 8 0 188533147 937435136 8774 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1411.92
Current children cumulated vsize (KiB) 915464

[startup+1483.89 s]
/proc/loadavg: 2.01 2.02 2.00 3/101 29486
/proc/meminfo: memFree=1648528/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1471.95
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9132 0 1 0 147183 12 0 0 25 0 8 0 188533147 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073736254 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8828 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 405 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) R 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1471.95
Current children cumulated vsize (KiB) 915464

[startup+1543.98 s]
/proc/loadavg: 2.00 2.02 2.00 3/101 29486
/proc/meminfo: memFree=1648592/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1531.96
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9132 0 1 0 153184 12 0 0 25 0 8 0 188533147 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073732681 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8828 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 405 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8828 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1531.96
Current children cumulated vsize (KiB) 915464

[startup+1604.07 s]
/proc/loadavg: 2.12 2.04 2.01 3/101 29486
/proc/meminfo: memFree=1648592/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1591.99
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9133 0 1 0 159187 12 0 0 25 0 8 0 188533147 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073731368 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8829 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 405 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8829 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1591.99
Current children cumulated vsize (KiB) 915464

[startup+1664.16 s]
/proc/loadavg: 2.11 2.05 2.01 3/101 29486
/proc/meminfo: memFree=1648528/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1652.03
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9138 0 1 0 165190 13 0 0 25 0 8 0 188533147 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479193 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8834 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 405 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8834 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1652.03
Current children cumulated vsize (KiB) 915464

[startup+1724.25 s]
/proc/loadavg: 2.11 2.05 2.01 3/101 29486
/proc/meminfo: memFree=1648528/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1712.04
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9146 0 1 0 171191 13 0 0 25 0 8 0 188533147 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073732707 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8842 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 407 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8842 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1712.04
Current children cumulated vsize (KiB) 915464

[startup+1784.32 s]
/proc/loadavg: 2.04 2.04 2.00 3/101 29486
/proc/meminfo: memFree=1648528/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1772.05
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9149 0 1 0 177192 13 0 0 25 0 8 0 188533147 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073742839 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8844 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 407 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1772.05
Current children cumulated vsize (KiB) 915464



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1812.38 s]
/proc/loadavg: 2.02 2.04 2.00 3/101 29486
/proc/meminfo: memFree=1648528/2055920 swapFree=4171244/4192956
[pid=29203] ppid=29201 vsize=915464 CPUtime=1800.08
/proc/29203/stat : 29203 (java) R 29201 29203 29136 0 -1 0 9149 0 1 0 179995 13 0 0 25 0 8 0 188533147 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072918504 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/29203/statm: 228866 8844 2543 14 0 215336 0
[pid=29203/tid=29205] ppid=29201 vsize=915464 CPUtime=0.02
/proc/29203/task/29205/stat : 29205 (java) S 29201 29203 29136 0 -1 64 198 0 0 0 2 0 0 0 16 0 8 0 188533151 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29206] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29206/stat : 29206 (java) S 29201 29203 29136 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188533151 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29207] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29207/stat : 29207 (java) S 29201 29203 29136 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188533151 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29208] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29208/stat : 29208 (java) S 29201 29203 29136 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29209] ppid=29201 vsize=915464 CPUtime=0.24
/proc/29203/task/29209/stat : 29209 (java) S 29201 29203 29136 0 -1 64 407 0 0 0 23 1 0 0 16 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=29203/tid=29210] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29210/stat : 29210 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=29203/tid=29211] ppid=29201 vsize=915464 CPUtime=0
/proc/29203/task/29211/stat : 29211 (java) S 29201 29203 29136 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 188533155 937435136 8844 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 915464

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1812.44
CPU time (s): 1800.14
CPU user time (s): 1800
CPU system time (s): 0.139978
CPU usage (%): 99.3211
Max. virtual memory (cumulated for all children) (KiB): 915464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800
system time used= 0.139978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9168
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37831
involuntary context switches= 83145

runsolver used 2.33864 s user time and 5.75212 s system time

The end

Launcher Data (download as text)

Begin job on node19 on Wed Jan 10 03:56:25 UTC 2007


IDJOB= 248817
IDBENCH= 11736
FILE ID= node19/248817-1168401385

PBS_JOBID= 3523041

Free space on /tmp= 66563 MiB

BENCH NAME= HOME/pub/bench/CPAI06/primes/primes-25/primes-25-40-3-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/248817-1168401385/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node19/watcher-248817-1168401385 -o ROOT/results/node19/solver-248817-1168401385 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/248817-1168401385/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  ecdf56a5d6ac73aa5328c124b08f36c3

RANDOM SEED= 855744085

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.260
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.260
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1118632 kB
Buffers:         51864 kB
Cached:         188424 kB
SwapCached:      10428 kB
Active:         785676 kB
Inactive:        93128 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1118632 kB
SwapTotal:     4192956 kB
SwapFree:      4171244 kB
Dirty:            1892 kB
Writeback:           0 kB
Mapped:         655356 kB
Slab:            41744 kB
Committed_AS:  6349700 kB
PageTables:       3648 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66560 MiB



End job on node19 on Wed Jan 10 04:26:38 UTC 2007