Trace number 1515067

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT4J CORE 2.1 RC1? (TO) 1200.22 1200.05

General information on the benchmark

NameRANDOM/MEDIUM/5SAT/UNKNOWN/100/
unif-k5-r21.3-v100-c2130-S1050568800-025.cnf
MD5SUMe85d34ddccfa23997bc15509ac656c11
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark799.183
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of clauses2130
Sum of the clauses size10650
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52130
Number of clauses of size over 50

Solver Data 

0.08/0.14	c SAT4J: a SATisfiability library for Java (c) 2004-2008 Daniel Le Berre
0.08/0.14	c This is free software under the dual EPL/GNU LGPL licenses.
0.08/0.14	c See www.sat4j.org for details.
0.08/0.15	c version 2.1.0.v20090228
0.08/0.15	c sun.arch.data.model	32
0.08/0.15	c java.version	1.6.0_12
0.08/0.15	c os.name	Linux
0.08/0.15	c os.version	2.6.9-22.EL.rootsmp
0.08/0.15	c os.arch	i386
0.08/0.15	c Free memory 1651659224
0.08/0.15	c Max memory 1654456320
0.08/0.15	c Total memory 1654456320
0.08/0.15	c Number of processors 2
0.08/0.19	c c --- Begin Solver configuration ---
0.08/0.19	c Stops conflict analysis at the first Unique Implication Point
0.08/0.19	c org.sat4j.minisat.constraints.MixedDataStructureDanielWL@11b9fb1
0.08/0.19	c Limit learning to clauses of size smaller or equal to 10% of the number of variables
0.08/0.19	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.1 initConflictBound=100 
0.08/0.19	c VSIDS like heuristics from MiniSAT using a heap lightweight component caching from RSAT
0.08/0.19	c Expensive reason simplification
0.08/0.19	c Armin Biere (Picosat) restarts strategy
0.08/0.19	c timeout=2147483647s
0.08/0.19	c DB Simplification allowed=true
0.08/0.19	c --- End Solver configuration ---
0.22/0.20	c solving HOME/instance-1515067-1238248804.cnf
0.22/0.20	c reading problem ... 
0.22/0.29	c ... done. Wall clock time 0.098s.
0.22/0.29	c #vars     100
0.22/0.29	c #constraints  2130
0.22/0.29	c constraints type 
0.22/0.29	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 2130
1200.01/1199.91	c starts		: 1702
1200.01/1199.91	c conflicts		: 2553299
1200.01/1199.91	c decisions		: 2863804
1200.01/1199.91	c propagations		: 39629136
1200.01/1199.91	c inspects		: 5941253309
1200.01/1199.91	c learnt literals	: 0
1200.01/1199.91	c learnt binary clauses	: 0
1200.01/1199.91	c learnt ternary clauses	: 0
1200.01/1199.91	c learnt clauses	: 43909
1200.01/1199.91	c ignored clauses	: 2509390
1200.01/1199.91	c root simplifications	: 1702
1200.01/1199.91	c removed literals (reason simplification)	: 8527177
1200.01/1199.91	c reason swapping (by a shorter reason)	: 0
1200.01/1199.91	c Calls to reduceDB	: 0
1200.01/1199.91	c speed (assignments/second)	: 33034.60498072314
1200.01/1199.91	c non guided choices	26
1200.01/1199.97	c learnt constraints type 
1200.01/1199.97	c org.sat4j.minisat.constraints.cnf.LearntWLClause => 43909
1200.01/1199.97	s UNKNOWN
1200.01/1199.97	c Total wall clock time (in seconds) : 1199.723

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1515067-1238248804/watcher-1515067-1238248804 -o /tmp/evaluation-result-1515067-1238248804/solver-1515067-1238248804 -C 1200 -W 1800 -M 1800 --output-limit 1,15 java6 -server -Xms1600m -Xmx1600m -jar HOME/org.sat4j.core.jar HOME/instance-1515067-1238248804.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.97 0.98 2/72 2860
/proc/meminfo: memFree=1693256/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=152 CPUtime=0
/proc/2860/stat : 2860 (java6) R 2858 2860 2501 0 -1 0 41 0 0 0 0 0 0 0 20 0 1 0 1097541578 155648 26 1992294400 134512640 134550932 4294956176 18446744073709551615 6890276 0 0 4096 0 0 0 0 17 1 0 0
/proc/2860/statm: 38 26 19 9 0 4 0

[startup+0.043839 s]
/proc/loadavg: 0.99 0.97 0.98 2/72 2860
/proc/meminfo: memFree=1693256/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1777088 CPUtime=0.03
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 3320 0 1 0 2 1 0 0 18 0 4 0 1097541578 1819738112 3067 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16784584 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 444272 3067 938 9 0 441623 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 1777088

[startup+0.101848 s]
/proc/loadavg: 0.99 0.97 0.98 2/72 2860
/proc/meminfo: memFree=1693256/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1780924 CPUtime=0.08
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 3892 0 1 0 6 2 0 0 18 0 12 0 1097541578 1823666176 3635 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 445231 3635 1067 9 0 442578 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 1780924

[startup+0.301886 s]
/proc/loadavg: 0.99 0.97 0.98 2/72 2860
/proc/meminfo: memFree=1693256/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1784140 CPUtime=0.39
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 5283 0 1 0 36 3 0 0 18 0 13 0 1097541578 1826959360 5021 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446035 5021 1367 9 0 443382 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 1784140

[startup+0.701955 s]
/proc/loadavg: 0.99 0.97 0.98 2/72 2860
/proc/meminfo: memFree=1693256/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786492 CPUtime=1.03
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 6567 0 1 0 99 4 0 0 18 0 13 0 1097541578 1829367808 5787 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446623 5787 1405 9 0 443970 0
Current children cumulated CPU time (s) 1.03
Current children cumulated vsize (KiB) 1786492

[startup+1.50209 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2873
/proc/meminfo: memFree=1674912/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786492 CPUtime=1.92
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 6971 0 1 0 188 4 0 0 18 0 13 0 1097541578 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446623 6157 1409 9 0 443970 0
[pid=2860/tid=2862] ppid=2858 vsize=1786492 CPUtime=1.27
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 4237 0 1 0 125 2 0 0 20 0 13 0 1097541579 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4109502105 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 1097541581 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 1097541581 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 1097541582 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 1097541583 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 23 0 13 0 1097541583 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1786492 CPUtime=0.29
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 692 0 0 0 29 0 0 0 15 0 13 0 1097541587 1829367808 6157 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1786492 CPUtime=0.33
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 33 0 0 0 15 0 13 0 1097541587 1829367808 6158 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1829367808 6158 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1829367808 6158 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1829367808 6158 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.92
Current children cumulated vsize (KiB) 1786492

[startup+3.10139 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2873
/proc/meminfo: memFree=1672736/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786492 CPUtime=3.55
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 7655 0 1 0 351 4 0 0 18 0 13 0 1097541578 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446623 6840 1409 9 0 443970 0
[pid=2860/tid=2862] ppid=2858 vsize=1786492 CPUtime=2.86
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 4919 0 1 0 284 2 0 0 25 0 13 0 1097541579 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4109536503 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 1097541581 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 1097541581 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 1097541582 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 1097541583 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 23 0 13 0 1097541583 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1786492 CPUtime=0.32
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 694 0 0 0 32 0 0 0 17 0 13 0 1097541587 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1786492 CPUtime=0.33
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 33 0 0 0 15 0 13 0 1097541587 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1786492 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1829367808 6840 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.55
Current children cumulated vsize (KiB) 1786492

[startup+6.30297 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2873
/proc/meminfo: memFree=1667616/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786396 CPUtime=6.74
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 8749 0 1 0 670 4 0 0 18 0 13 0 1097541578 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446599 7909 1409 9 0 443946 0
[pid=2860/tid=2862] ppid=2858 vsize=1786396 CPUtime=6.06
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 6013 0 1 0 604 2 0 0 25 0 13 0 1097541579 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4109581210 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 1097541581 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 1097541581 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 1097541582 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 1097541583 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 23 0 13 0 1097541583 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1786396 CPUtime=0.32
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 694 0 0 0 32 0 0 0 17 0 13 0 1097541587 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1786396 CPUtime=0.33
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 33 0 0 0 15 0 13 0 1097541587 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1829269504 7909 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.74
Current children cumulated vsize (KiB) 1786396

[startup+12.7011 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2873
/proc/meminfo: memFree=1660128/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786396 CPUtime=13.14
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 10491 0 1 0 1309 5 0 0 18 0 13 0 1097541578 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446599 9651 1409 9 0 443946 0
[pid=2860/tid=2862] ppid=2858 vsize=1786396 CPUtime=12.46
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 7755 0 1 0 1243 3 0 0 25 0 13 0 1097541579 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4109581064 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 1097541581 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 1097541581 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 1097541582 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 1097541583 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 23 0 13 0 1097541583 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1786396 CPUtime=0.32
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 694 0 0 0 32 0 0 0 17 0 13 0 1097541587 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1786396 CPUtime=0.33
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 33 0 0 0 15 0 13 0 1097541587 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1786396 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1829269504 9651 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 13.14
Current children cumulated vsize (KiB) 1786396

[startup+25.5025 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2873
/proc/meminfo: memFree=1649248/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786108 CPUtime=25.94
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 13117 0 1 0 2587 7 0 0 18 0 13 0 1097541578 1828974592 12205 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446527 12205 1409 9 0 443874 0
[pid=2860/tid=2862] ppid=2858 vsize=1786108 CPUtime=25.26
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 10381 0 1 0 2520 6 0 0 25 0 13 0 1097541579 1828974592 12205 1992294400 134512640 134550932 4294956000 18446744073709551615 4109536407 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1786108 CPUtime=0
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 1097541581 1828974592 12205 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1786108 CPUtime=0
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 1097541581 1828974592 12205 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0

################
# More data... #
################

/proc/2860/statm: 446449 41526 1418 9 0 443796 0
[pid=2860/tid=2862] ppid=2858 vsize=1785796 CPUtime=1061.66
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 37566 0 1 0 106128 38 0 0 25 0 13 0 1097541579 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4109536407 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1785796 CPUtime=0.02
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 1002 0 0 0 2 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1785796 CPUtime=0.03
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1221 0 0 0 3 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 11 0 0 0 0 0 0 0 16 0 13 0 1097541582 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 17 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 696 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1062.45
Current children cumulated vsize (KiB) 1785796

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2879
/proc/meminfo: memFree=1531104/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1785796 CPUtime=1122.43
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 42536 0 1 0 112202 41 0 0 18 0 13 0 1097541578 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446449 41526 1418 9 0 443796 0
[pid=2860/tid=2862] ppid=2858 vsize=1785796 CPUtime=1121.64
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 37566 0 1 0 112126 38 0 0 25 0 13 0 1097541579 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4109472110 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1785796 CPUtime=0.02
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 1002 0 0 0 2 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1785796 CPUtime=0.03
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1221 0 0 0 3 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 11 0 0 0 0 0 0 0 16 0 13 0 1097541582 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 17 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 696 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1122.43
Current children cumulated vsize (KiB) 1785796

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2879
/proc/meminfo: memFree=1531040/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1785796 CPUtime=1182.41
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 42536 0 1 0 118200 41 0 0 18 0 13 0 1097541578 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446449 41526 1418 9 0 443796 0
[pid=2860/tid=2862] ppid=2858 vsize=1785796 CPUtime=1181.62
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 37566 0 1 0 118124 38 0 0 25 0 13 0 1097541579 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4109536407 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1785796 CPUtime=0.02
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 1002 0 0 0 2 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1785796 CPUtime=0.03
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1221 0 0 0 3 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 11 0 0 0 0 0 0 0 16 0 13 0 1097541582 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 17 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 696 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1182.41
Current children cumulated vsize (KiB) 1785796



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1199.9 s]
/proc/loadavg: 0.99 0.97 0.98 2/85 2879
/proc/meminfo: memFree=1531040/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1785796 CPUtime=1200.01
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 42536 0 1 0 119960 41 0 0 18 0 13 0 1097541578 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2860/statm: 446449 41526 1418 9 0 443796 0
[pid=2860/tid=2862] ppid=2858 vsize=1785796 CPUtime=1199.22
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 37566 0 1 0 119884 38 0 0 25 0 13 0 1097541579 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4109536407 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1785796 CPUtime=0.02
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 1002 0 0 0 2 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1785796 CPUtime=0.03
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1221 0 0 0 3 0 0 0 16 0 13 0 1097541581 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 11 0 0 0 0 0 0 0 16 0 13 0 1097541582 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 17 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 1097541583 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 0 0 0 0 0 0 0 0 24 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 696 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1785796 CPUtime=0.34
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1295 0 0 0 34 0 0 0 16 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 1097541587 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1785796 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 13 0 1097541608 1828655104 41526 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 1785796

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.01 s]
/proc/loadavg: 0.99 0.97 0.98 2/87 2882
/proc/meminfo: memFree=1530960/2055920 swapFree=4174692/4192956
[pid=2860] ppid=2858 vsize=1786444 CPUtime=1200.18
/proc/2860/stat : 2860 (java) S 2858 2860 2501 0 -1 0 42563 0 1 0 119977 41 0 0 16 0 14 0 1097541578 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2860/statm: 446611 41553 1421 9 0 443958 0
[pid=2860/tid=2862] ppid=2858 vsize=1786444 CPUtime=1199.33
/proc/2860/task/2862/stat : 2862 (java) R 2858 2860 2501 0 -1 64 37566 0 1 0 119895 38 0 0 25 0 14 0 1097541579 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4109472088 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2863] ppid=2858 vsize=1786444 CPUtime=0.02
/proc/2860/task/2863/stat : 2863 (java) S 2858 2860 2501 0 -1 64 1002 0 0 0 2 0 0 0 16 0 14 0 1097541581 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2864] ppid=2858 vsize=1786444 CPUtime=0.03
/proc/2860/task/2864/stat : 2864 (java) S 2858 2860 2501 0 -1 64 1221 0 0 0 3 0 0 0 16 0 14 0 1097541581 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2865] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2865/stat : 2865 (java) S 2858 2860 2501 0 -1 64 11 0 0 0 0 0 0 0 16 0 14 0 1097541582 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2866] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2866/stat : 2866 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 17 0 14 0 1097541583 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2867] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2867/stat : 2867 (java) S 2858 2860 2501 0 -1 64 7 0 0 0 0 0 0 0 16 0 14 0 1097541583 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2868] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2868/stat : 2868 (java) S 2858 2860 2501 0 -1 64 6 0 0 0 0 0 0 0 18 0 14 0 1097541587 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2869] ppid=2858 vsize=1786444 CPUtime=0.34
/proc/2860/task/2869/stat : 2869 (java) S 2858 2860 2501 0 -1 64 696 0 0 0 34 0 0 0 16 0 14 0 1097541587 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2870] ppid=2858 vsize=1786444 CPUtime=0.38
/proc/2860/task/2870/stat : 2870 (java) S 2858 2860 2501 0 -1 64 1299 0 0 0 38 0 0 0 16 0 14 0 1097541587 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2871] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2871/stat : 2871 (java) S 2858 2860 2501 0 -1 64 2 0 0 0 0 0 0 0 25 0 14 0 1097541587 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2872] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2872/stat : 2872 (java) S 2858 2860 2501 0 -1 64 1 0 0 0 0 0 0 0 15 0 14 0 1097541587 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2860/tid=2873] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2873/stat : 2873 (java) S 2858 2860 2501 0 -1 64 4 0 0 0 0 0 0 0 19 0 14 0 1097541608 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2860/tid=2881] ppid=2858 vsize=1786444 CPUtime=0
/proc/2860/task/2881/stat : 2881 (java) S 2858 2860 2501 0 -1 64 10 0 0 0 0 0 0 0 17 0 14 0 1097661570 1829318656 41553 1992294400 134512640 134550932 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1200.18
Current children cumulated vsize (KiB) 1786444

Child status: 143
Real time (s): 1200.05
CPU time (s): 1200.22
CPU user time (s): 1199.78
CPU system time (s): 0.443932
CPU usage (%): 100.015
Max. virtual memory (cumulated for all children) (KiB): 1786676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.78
system time used= 0.443932
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 42564
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24665
involuntary context switches= 2301

runsolver used 1.58876 second user time and 3.88141 second system time

The end

Launcher Data 

Begin job on node67 at 2009-03-28 15:00:04
IDJOB=1515067
IDBENCH=70399
IDSOLVER=500
FILE ID=node67/1515067-1238248804
PBS_JOBID= 9060725
Free space on /tmp= 66376 MiB

SOLVER NAME= SAT4J CORE  2.1 RC1
BENCH NAME= SAT09/RANDOM/MEDIUM/5SAT/UNKNOWN/100/unif-k5-r21.3-v100-c2130-S1050568800-025.cnf
COMMAND LINE= java6 -server -Xms1600m -Xmx1600m -jar HOME/org.sat4j.core.jar BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1515067-1238248804/watcher-1515067-1238248804 -o /tmp/evaluation-result-1515067-1238248804/solver-1515067-1238248804 -C 1200 -W 1800 -M 1800 --output-limit 1,15  java6 -server -Xms1600m -Xmx1600m -jar HOME/org.sat4j.core.jar HOME/instance-1515067-1238248804.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= e85d34ddccfa23997bc15509ac656c11
RANDOM SEED=349725513

node67.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1693736 kB
Buffers:         47364 kB
Cached:         247868 kB
SwapCached:       9680 kB
Active:         100888 kB
Inactive:       205512 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1693736 kB
SwapTotal:     4192956 kB
SwapFree:      4174692 kB
Dirty:             220 kB
Writeback:           0 kB
Mapped:          16820 kB
Slab:            40860 kB
Committed_AS:  3055368 kB
PageTables:       2052 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66376 MiB
End job on node67 at 2009-03-28 15:20:06