Trace number 201128

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.09 1809.04

General information on the benchmark

Namefapp/fapp11-15/fapp15/
fapp15-3000-5.xml
MD5SUMcbf1a33575819e47024f404c59ea6857
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1205.71
SatisfiableYES
(Un)Satisfiability was proved
Number of variables3000
Number of constraints33021
Maximum constraint arity2
Maximum domain size182
Number of constraints which are defined in extension0
Number of constraints which are defined in intension33021
Global constraints used (with number of constraints)

Solver Data (download as text)

0.32	   
0.32	Abscon 109 (November, 2006)
0.32	   
0.32	   configuration
0.32	     name=mac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/201128-1168072260/unknown.xml
0.38	   
0.38	   domains being loaded...
0.41	   
0.41	   variables being loaded...
0.68	     nbVariables=3000  nbDomainTypes=23  minDomainSize=42  maxDomainSize=182
0.68	       =>  wckTime=0.365  cpuTime=0.27  mem=27M376
0.68	   
0.68	   predicates being loaded...
0.69	   
0.69	   constraints being loaded...
4.64	   
4.64	   INFO : Stopping converting binary constraints (cpu=4.01, mem = 52M698)
8.27	     nbConstraints=17754  nbMergedConstraints=15267  nbConvertedConstraints=160  nbConvertConstraintsChecks=4185528
8.27	     nbExtensionStructures=144  nbSharedExtensionStructures=16  nbConflictsStructures=144
8.27	     nbSharedConflictsStructures=16  nbSharedBinaryRepresentations=29892  nbEvaluationManagers=9665
8.27	     nbSharedEvaluationManagers=7929  maxDegree=15  maxArity=2
8.27	       =>  wckTime=7.954  cpuTime=7.11  mem=71M327
8.54	   
8.54	   solver IterativeSystematicSolver being built... 
9.13	       =>  wckTime=8.814  cpuTime=7.54  mem=97M152
34.21	   
34.21	   preprocessing
34.21	     nbConstraintChecks=46567079  nbValidityChecks=2168182  nbPropagations=4061  nbRevisions=54685
34.21	     nbUselessRevisions=48174  nbRemovedValues=209479  detectedInconsistency=no
34.21	       =>  wckTime=25.051  cpuTime=24.89  mem=97M152
47.72	   
47.72	   search
47.72	     run=0  nbConstraintChecks=19969108  nbValidityChecks=16427329  nbPropagations=27654  nbRevisions=306445
47.72	     nbUselessRevisions=270921  nbAssignments=402  nbFailedAssignments=13  nbBacktracks=26  nbVisitedNodes=421
47.72	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=389
47.72	       =>  wckTime=38.563  cpuTime=38.31  mem=99M165
54.56	   
54.56	   search
54.56	     run=1  nbConstraintChecks=28020117  nbValidityChecks=34519561  nbPropagations=82490  nbRevisions=910496
54.56	     nbUselessRevisions=804112  nbAssignments=812  nbFailedAssignments=21  nbBacktracks=46  nbVisitedNodes=844
54.56	     nbRestartNogoods=10  mapSize=0  nbInferences=0  nbTooLargeKeys=791
54.56	       =>  wckTime=45.408  cpuTime=45.12  mem=99M165
59.50	   
59.50	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1183, mem=99M165)
60.35	   
60.35	   search
60.35	     run=2  nbConstraintChecks=34996489  nbValidityChecks=51564316  nbPropagations=162168  nbRevisions=1780289
60.35	     nbUselessRevisions=1573150  nbAssignments=1242  nbFailedAssignments=29  nbBacktracks=81  nbVisitedNodes=1294
60.35	     nbRestartNogoods=13
60.35	       =>  wckTime=51.199  cpuTime=50.88  mem=99M165
65.58	   
65.58	   search
65.58	     run=3  nbConstraintChecks=41827536  nbValidityChecks=68672337  nbPropagations=266558  nbRevisions=2915022
65.58	     nbUselessRevisions=2577026  nbAssignments=1686  nbFailedAssignments=41  nbBacktracks=117  nbVisitedNodes=1766
65.58	     nbRestartNogoods=15
65.58	       =>  wckTime=56.426  cpuTime=56.09  mem=99M165
73.02	   
73.02	   search
73.02	     run=4  nbConstraintChecks=52621054  nbValidityChecks=81954328  nbPropagations=387026  nbRevisions=4226719
73.02	     nbUselessRevisions=3734459  nbAssignments=2088  nbFailedAssignments=172  nbBacktracks=168  nbVisitedNodes=2327
73.02	     nbRestartNogoods=18
73.02	       =>  wckTime=63.869  cpuTime=63.49  mem=99M165
85.41	   
85.41	   search
85.41	     run=5  nbConstraintChecks=69955057  nbValidityChecks=101730570  nbPropagations=538109  nbRevisions=5888629
85.41	     nbUselessRevisions=5185200  nbAssignments=2529  nbFailedAssignments=226  nbBacktracks=243  nbVisitedNodes=2847
85.41	     nbRestartNogoods=22
85.41	       =>  wckTime=76.257  cpuTime=75.82  mem=99M165
94.00	   
94.01	   search
94.01	     run=6  nbConstraintChecks=80023690  nbValidityChecks=124335545  nbPropagations=725706  nbRevisions=7976177
94.01	     nbUselessRevisions=6990695  nbAssignments=2993  nbFailedAssignments=264  nbBacktracks=357  nbVisitedNodes=3385
94.01	     nbRestartNogoods=54
94.01	       =>  wckTime=84.854  cpuTime=84.37  mem=99M165
104.71	   
104.71	   search
104.71	     run=7  nbConstraintChecks=92268393  nbValidityChecks=151234013  nbPropagations=959501  nbRevisions=10607686
104.71	     nbUselessRevisions=9242256  nbAssignments=3534  nbFailedAssignments=324  nbBacktracks=529  nbVisitedNodes=4046
104.71	     nbRestartNogoods=57
104.71	       =>  wckTime=95.554  cpuTime=95.03  mem=99M165
156.67	   
156.67	   search
156.67	     run=8  nbConstraintChecks=145854821  nbValidityChecks=255803132  nbPropagations=1416865  nbRevisions=16001404
156.67	     nbUselessRevisions=13646159  nbAssignments=4470  nbFailedAssignments=737  nbBacktracks=786  nbVisitedNodes=5522
156.67	     nbRestartNogoods=65
156.67	       =>  wckTime=147.523  cpuTime=146.76  mem=99M165
185.00	   
185.00	   search
185.00	     run=9  nbConstraintChecks=179069112  nbValidityChecks=302015996  nbPropagations=1957379  nbRevisions=22252237
185.00	     nbUselessRevisions=18759625  nbAssignments=8045  nbFailedAssignments=3319  nbBacktracks=1170  nbVisitedNodes=11844
185.00	     nbRestartNogoods=93
185.00	       =>  wckTime=175.85  cpuTime=174.94  mem=99M165
199.66	   
199.66	   search
199.66	     run=10  nbConstraintChecks=191829290  nbValidityChecks=336525631  nbPropagations=2610191  nbRevisions=29659809
199.66	     nbUselessRevisions=24815813  nbAssignments=9519  nbFailedAssignments=3660  nbBacktracks=1747  nbVisitedNodes=13768
199.66	     nbRestartNogoods=139
199.66	       =>  wckTime=190.505  cpuTime=189.54  mem=99M165
217.20	   
217.20	   search
217.20	     run=11  nbConstraintChecks=210486099  nbValidityChecks=369060920  nbPropagations=3356656  nbRevisions=38063299
217.20	     nbUselessRevisions=31716247  nbAssignments=10941  nbFailedAssignments=3728  nbBacktracks=2631  nbVisitedNodes=15322
217.20	     nbRestartNogoods=159
217.20	       =>  wckTime=208.047  cpuTime=207.0  mem=99M165
237.66	   
237.66	   search
237.66	     run=12  nbConstraintChecks=228112979  nbValidityChecks=412870379  nbPropagations=4246949  nbRevisions=48004689
237.66	     nbUselessRevisions=39902771  nbAssignments=12862  nbFailedAssignments=3851  nbBacktracks=3936  nbVisitedNodes=17479
237.66	     nbRestartNogoods=174
237.66	       =>  wckTime=228.506  cpuTime=227.36  mem=99M165
423.39	   
423.39	   search
423.39	     run=13  nbConstraintChecks=420102730  nbValidityChecks=795372759  nbPropagations=6018074  nbRevisions=68645594
423.39	     nbUselessRevisions=56612991  nbAssignments=17398  nbFailedAssignments=6176  nbBacktracks=5883  nbVisitedNodes=25089
423.39	     nbRestartNogoods=180
423.39	       =>  wckTime=414.237  cpuTime=412.24  mem=99M165
813.90	   
813.90	   search
813.90	     run=14  nbConstraintChecks=814214457  nbValidityChecks=1636469404  nbPropagations=9505451  nbRevisions=111246305
813.90	     nbUselessRevisions=90267766  nbAssignments=25649  nbFailedAssignments=11322  nbBacktracks=8803
813.90	     nbVisitedNodes=40022  nbRestartNogoods=203
813.90	       =>  wckTime=804.744  cpuTime=800.99  mem=99M165
1414.70	   
1414.70	   search
1414.70	     run=15  nbConstraintChecks=1518770853  nbValidityChecks=3008104049  nbPropagations=15156152  nbRevisions=180468190
1414.70	     nbUselessRevisions=146010405  nbAssignments=37686  nbFailedAssignments=18821  nbBacktracks=13182
1414.70	     nbVisitedNodes=61710  nbRestartNogoods=238
1414.70	       =>  wckTime=1405.546  cpuTime=1399.09  mem=99M165

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node56/watcher-201128-1168072260 -o ROOT/results/node56/solver-201128-1168072260 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201128-1168072260/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.56 1.90 1.80 2/70 4182
/proc/meminfo: memFree=1675600/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=18540 CPUtime=0
/proc/4181/stat : 4181 (runsolver) R 4178 4181 3732 0 -1 4194368 17 0 0 0 0 0 0 0 20 0 1 0 155624595 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 253307186471 0 2147483391 4096 24578 0 0 0 17 0 0 0
/proc/4181/statm: 4635 279 244 17 0 2626 0

[startup+0.102939 s]
/proc/loadavg: 1.56 1.90 1.80 2/70 4182
/proc/meminfo: memFree=1675600/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=914988 CPUtime=0.08
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 2957 0 1 0 6 2 0 0 25 0 8 0 155624595 936947712 2703 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153558539 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 228747 2703 1416 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.510981 s]
/proc/loadavg: 1.56 1.90 1.80 2/70 4182
/proc/meminfo: memFree=1675600/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=915328 CPUtime=0.48
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 6920 0 1 0 44 4 0 0 25 0 8 0 155624595 937295872 6659 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4152819938 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/4181/statm: 228832 6661 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33206 s]
/proc/loadavg: 1.56 1.90 1.80 3/87 4199
/proc/meminfo: memFree=1527560/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=915648 CPUtime=1.3
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 22848 0 1 0 117 13 0 0 25 0 8 0 155624595 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073682750 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/4181/statm: 228912 22585 2160 14 0 215382 0
[pid=4181/tid=4186] ppid=4178 vsize=915648 CPUtime=0.1
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 6305 0 0 0 7 3 0 0 16 0 8 0 155624599 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4188] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155624600 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155624600 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=915648 CPUtime=0.15
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 409 0 0 0 15 0 0 0 15 0 8 0 155624603 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4194] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155624603 937623552 22585 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915648

[startup+2.97622 s]
/proc/loadavg: 1.56 1.90 1.80 4/87 4199
/proc/meminfo: memFree=1501384/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=915648 CPUtime=2.93
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 24030 0 1 0 278 15 0 0 25 0 8 0 155624595 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832843 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/4181/statm: 228912 23764 2180 14 0 215382 0
[pid=4181/tid=4186] ppid=4178 vsize=915648 CPUtime=0.17
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 7409 0 0 0 14 3 0 0 17 0 8 0 155624599 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4188] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155624600 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155624600 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=915648 CPUtime=0.18
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 423 0 0 0 18 0 0 0 15 0 8 0 155624603 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4194] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=915648 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155624603 937623552 23764 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915648

[startup+6.18154 s]
/proc/loadavg: 1.67 1.92 1.80 3/87 4199
/proc/meminfo: memFree=1483784/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916672 CPUtime=6.12
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 27047 0 1 0 596 16 0 0 25 0 8 0 155624595 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479856 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/4181/statm: 229168 26778 2181 14 0 215638 0
[pid=4181/tid=4186] ppid=4178 vsize=916672 CPUtime=0.35
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 10396 0 0 0 31 4 0 0 16 0 8 0 155624599 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916672 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155624600 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916672 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155624600 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916672 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916672 CPUtime=0.23
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 448 0 0 0 22 1 0 0 15 0 8 0 155624603 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916672 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916672 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938672128 26778 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.12
Current children cumulated vsize (KiB) 916672

[startup+12.6482 s]
/proc/loadavg: 1.78 1.94 1.81 2/75 4210
/proc/meminfo: memFree=1543984/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=12.56
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37280 0 1 0 1235 21 0 0 25 0 8 0 155624595 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/4181/statm: 229238 36969 2533 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20080 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.35
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 557 0 0 0 34 1 0 0 15 0 8 0 155624603 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 36969 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 916952

[startup+25.5014 s]
/proc/loadavg: 1.76 1.92 1.81 3/87 4255
/proc/meminfo: memFree=1395216/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=25.36
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37284 0 1 0 2513 23 0 0 25 0 8 0 155624595 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839204 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 36970 2533 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20080 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.35
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 561 0 0 0 34 1 0 0 16 0 8 0 155624603 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 36970 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 916952

[startup+51.1119 s]
/proc/loadavg: 1.84 1.93 1.81 3/87 4255
/proc/meminfo: memFree=1395472/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=50.83
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37315 0 1 0 5060 23 0 0 25 0 8 0 155624595 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072942942 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 36991 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 17 0 8 0 155624599 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.39
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 576 0 0 0 37 2 0 0 15 0 8 0 155624603 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 36991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 916952

[startup+102.332 s]
/proc/loadavg: 1.93 1.94 1.82 3/87 4255
/proc/meminfo: memFree=1395344/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=101.82
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37332 0 1 0 10159 23 0 0 25 0 8 0 155624595 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074236856 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37002 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.41
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 590 0 0 0 39 2 0 0 15 0 8 0 155624603 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37002 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 916952

[startup+162.399 s]
/proc/loadavg: 1.97 1.95 1.83 3/87 4255
/proc/meminfo: memFree=1395280/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=161.64
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37338 0 1 0 16140 24 0 0 25 0 8 0 155624595 938958848 37005 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073836919 0 4 0 23759 18446744073709551615 0 0 17 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1417.38
Current children cumulated vsize (KiB) 916952

[startup+1483.91 s]
/proc/loadavg: 2.05 2.07 1.97 3/87 4255
/proc/meminfo: memFree=1394768/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1477.17
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 147690 27 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074190811 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1477.17
Current children cumulated vsize (KiB) 916952

[startup+1543.98 s]
/proc/loadavg: 2.11 2.08 1.98 3/87 4255
/proc/meminfo: memFree=1394832/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1536.99
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 153671 28 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832743 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1536.99
Current children cumulated vsize (KiB) 916952

[startup+1604.05 s]
/proc/loadavg: 2.08 2.08 1.99 3/87 4255
/proc/meminfo: memFree=1394832/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1596.8
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 159652 28 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074191491 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1596.8
Current children cumulated vsize (KiB) 916952

[startup+1664.12 s]
/proc/loadavg: 2.06 2.08 2.00 3/87 4255
/proc/meminfo: memFree=1394832/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1656.41
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 165613 28 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074215417 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1656.41
Current children cumulated vsize (KiB) 916952

[startup+1724.19 s]
/proc/loadavg: 2.02 2.06 2.00 3/87 4255
/proc/meminfo: memFree=1394832/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1715.99
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 171571 28 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074216613 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1715.99
Current children cumulated vsize (KiB) 916952

[startup+1784.27 s]
/proc/loadavg: 2.01 2.05 2.00 3/87 4255
/proc/meminfo: memFree=1394768/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1775.56
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 177528 28 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074203411 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1775.56
Current children cumulated vsize (KiB) 916952



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.96 s]
/proc/loadavg: 2.00 2.04 2.00 3/93 4327
/proc/meminfo: memFree=1393472/2055920 swapFree=4184772/4192956
[pid=4181] ppid=4178 vsize=916952 CPUtime=1800
/proc/4181/stat : 4181 (java) R 4178 4181 3732 0 -1 0 37345 0 1 0 179968 32 0 0 25 0 8 0 155624595 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074276848 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/4181/statm: 229238 37009 2537 14 0 215708 0
[pid=4181/tid=4186] ppid=4178 vsize=916952 CPUtime=0.93
/proc/4181/task/4186/stat : 4186 (java) S 4178 4181 3732 0 -1 64 20081 0 0 0 85 8 0 0 16 0 8 0 155624599 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4188] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4188/stat : 4188 (java) S 4178 4181 3732 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4189] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4189/stat : 4189 (java) S 4178 4181 3732 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155624600 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=4181/tid=4192] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4192/stat : 4192 (java) S 4178 4181 3732 0 -1 64 1 0 0 0 0 0 0 0 24 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4193] ppid=4178 vsize=916952 CPUtime=0.43
/proc/4181/task/4193/stat : 4193 (java) S 4178 4181 3732 0 -1 64 601 0 0 0 41 2 0 0 16 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4194] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4194/stat : 4194 (java) S 4178 4181 3732 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=4181/tid=4195] ppid=4178 vsize=916952 CPUtime=0
/proc/4181/task/4195/stat : 4195 (java) S 4178 4181 3732 0 -1 64 2 0 0 0 0 0 0 0 15 0 8 0 155624603 938958848 37009 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 916952

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1809.04
CPU time (s): 1800.09
CPU user time (s): 1799.75
CPU system time (s): 0.346947
CPU usage (%): 99.5051
Max. virtual memory (cumulated for all children) (KiB): 916952

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.75
system time used= 0.346947
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37361
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38499
involuntary context switches= 64245

runsolver used 1.9557 s user time and 4.54931 s system time

The end

Launcher Data (download as text)

Begin job on node56 on Sat Jan  6 08:31:02 UTC 2007


IDJOB= 201128
IDBENCH= 3745
FILE ID= node56/201128-1168072260

PBS_JOBID= 3475940

Free space on /tmp= 66511 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp15/fapp15-3000-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201128-1168072260/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node56/watcher-201128-1168072260 -o ROOT/results/node56/solver-201128-1168072260 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201128-1168072260/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  cbf1a33575819e47024f404c59ea6857

RANDOM SEED= 23713639

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1676072 kB
Buffers:         26944 kB
Cached:         270060 kB
SwapCached:       2060 kB
Active:          55228 kB
Inactive:       257132 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1676072 kB
SwapTotal:     4192956 kB
SwapFree:      4184772 kB
Dirty:           12596 kB
Writeback:           0 kB
Mapped:          22312 kB
Slab:            53000 kB
Committed_AS:  2633264 kB
PageTables:       1796 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66512 MiB



End job on node56 on Sat Jan  6 09:01:16 UTC 2007