Trace number 4117289

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
Sat4j PB 2.3.6 Resolution PB16? (TO) 1800.02 1897.84

General information on the benchmark

NamePB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/
EmployeeScheduling/normalized-oct4.5.opb
MD5SUMea6cc84c6d68190182a9cd3413f0894a
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.72858
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9632
Total number of constraints29620
Number of constraints which are clauses27564
Number of constraints which are cardinality constraints (but not clauses)236
Number of constraints which are nor clauses,nor cardinality constraints1820
Minimum length of a constraint2
Maximum length of a constraint248
Number of terms in the objective function 26
Biggest coefficient in the objective function 200
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 2110
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 200
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 2110
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.10/85.29	c SAT4J: a SATisfiability library for Java (c) 2004-2013 Artois University and CNRS
0.10/85.29	c This is free software under the dual EPL/GNU LGPL licenses.
0.10/85.29	c See www.sat4j.org for details.
0.11/85.37	c version PB16.v20160501
0.11/85.37	c java.runtime.name	Java(TM) SE Runtime Environment
0.11/85.37	c java.vm.name		Java HotSpot(TM) 64-Bit Server VM
0.11/85.37	c java.vm.version	19.1-b02
0.11/85.37	c java.vm.vendor	Sun Microsystems Inc.
0.11/85.37	c sun.arch.data.model	64
0.11/85.37	c java.version		1.6.0_24
0.11/85.37	c os.name		Linux
0.11/85.37	c os.version		2.6.32-71.29.1.el6.x86_64
0.11/85.37	c os.arch		amd64
0.11/85.37	c Free memory 		501472288
0.11/85.37	c Max memory 		7480803328
0.11/85.37	c Total memory 		504102912
0.11/85.37	c Number of processors 	8
0.15/86.23	c Pseudo Boolean Optimization by upper bound
0.15/86.23	c --- Begin Solver configuration ---
0.15/86.23	c org.sat4j.pb.constraints.CompetResolutionPBLongMixedWLClauseCardConstrDataStructure@2b21cc40
0.15/86.23	c Learn all clauses as in MiniSAT
0.15/86.23	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.5 initConflictBound=100 
0.15/86.23	c VSIDS like heuristics from MiniSAT using a heap lightweight component caching from RSAT taking into account the objective function
0.15/86.23	c No reason simplification
0.15/86.23	c Glucose 2.1 dynamic restart strategy
0.15/86.23	c Glucose 2 learned constraints deletion strategy (LBD updated on propagation) with timer check every 1000 if the learned constraints reach increasing bounds: 5000 step 1000
0.15/86.23	c timeout=2147483s
0.15/86.23	c DB Simplification allowed=false
0.15/86.23	c Listener: org.sat4j.minisat.core.VoidTracing@7c64dc11
0.15/86.23	c --- End Solver configuration ---
0.15/86.23	c solving HOME/instance-4117289-1467208989.opb
0.15/86.23	c reading problem ... 
0.16/86.50	c  objective function found
1.16/95.70	c ... done. Wall clock time 9.465s.
1.16/95.70	c declared #vars     9632
1.16/95.70	c #constraints  29620
1.16/95.70	c constraints type 
1.16/101.37	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 11044
1.16/101.37	c org.sat4j.minisat.constraints.card.MinWatchCard => 292
1.16/101.37	c org.sat4j.minisat.constraints.cnf.OriginalBinaryClause => 16520
1.16/101.37	c org.sat4j.pb.constraints.pb.MaxWatchPbLong => 1764
1.16/101.37	c 29620 constraints processed.
1.16/101.37	c objective function length is 26 literals
2.13/102.75	c cleaning 2494 clauses out of 5000 with flag 16282/5000
3.26/103.20	c cleaning 4253 clauses out of 8507 with flag 29741/11001
4.17/103.82	c cleaning 5622 clauses out of 11254 with flag 46315/18001
5.16/104.53	c cleaning 6807 clauses out of 13631 with flag 66997/26000
5.99/105.35	c cleaning 7906 clauses out of 15824 with flag 89459/35000
7.21/106.56	c cleaning 8956 clauses out of 17919 with flag 114623/45001
8.31/107.66	c cleaning 9974 clauses out of 19962 with flag 142837/56000
9.51/108.85	c cleaning 10985 clauses out of 21989 with flag 173924/68001
11.21/110.55	c cleaning 11996 clauses out of 24003 with flag 207174/81000
12.71/112.04	c cleaning 12996 clauses out of 26007 with flag 247489/95000
14.51/113.80	c cleaning 14002 clauses out of 28013 with flag 288931/110002
16.71/116.07	c cleaning 14996 clauses out of 30009 with flag 331145/126000
18.71/118.02	c cleaning 15999 clauses out of 32014 with flag 371582/143001
21.21/120.59	c cleaning 17003 clauses out of 34016 with flag 418914/161002
24.02/123.34	c cleaning 18001 clauses out of 36011 with flag 468424/180000
26.71/126.02	c cleaning 18994 clauses out of 38010 with flag 517760/200000
29.61/128.91	c cleaning 19998 clauses out of 40016 with flag 572817/221000
33.06/132.30	c cleaning 20994 clauses out of 42018 with flag 628335/243000
36.56/135.88	c cleaning 22004 clauses out of 44025 with flag 688120/266001
40.76/140.07	c cleaning 23004 clauses out of 46020 with flag 746251/290000
44.56/143.83	c cleaning 23998 clauses out of 48016 with flag 815955/315000
48.96/148.22	c cleaning 25005 clauses out of 50018 with flag 884774/341000
54.66/153.96	c cleaning 26001 clauses out of 52015 with flag 953050/368002
61.56/160.90	c cleaning 26997 clauses out of 54012 with flag 1018471/396000
68.07/167.39	c cleaning 27998 clauses out of 56016 with flag 1089090/425001
73.99/173.26	c cleaning 29001 clauses out of 58019 with flag 1158999/455002
79.79/179.06	c cleaning 30000 clauses out of 60018 with flag 1232852/486002
87.59/186.82	c cleaning 31004 clauses out of 62017 with flag 1315133/518001
99.89/199.20	c cleaning 32002 clauses out of 64012 with flag 1393797/551000
108.59/207.88	c cleaning 33001 clauses out of 66011 with flag 1476562/585001
118.19/217.43	c cleaning 34001 clauses out of 68010 with flag 1565266/620001
127.79/227.05	c cleaning 34999 clauses out of 70008 with flag 1657690/656000
139.42/238.65	c cleaning 35999 clauses out of 72009 with flag 1750634/693000
151.32/250.56	c cleaning 36998 clauses out of 74010 with flag 1845262/731000
165.02/264.26	c cleaning 37999 clauses out of 76012 with flag 1942355/770000
176.34/275.54	c cleaning 39000 clauses out of 78014 with flag 2045429/810001
187.44/286.69	c cleaning 40004 clauses out of 80016 with flag 2149394/851003
202.58/301.73	c cleaning 41000 clauses out of 82010 with flag 2255030/893001
218.79/318.00	c cleaning 42000 clauses out of 84010 with flag 2360495/936001
232.58/331.73	c cleaning 43001 clauses out of 86015 with flag 2484321/980006
247.78/346.99	c cleaning 43998 clauses out of 88008 with flag 2601572/1025000
263.34/362.42	c cleaning 45004 clauses out of 90017 with flag 2718943/1071007
278.74/377.87	c cleaning 45999 clauses out of 92006 with flag 2829429/1118000
305.95/405.02	c cleaning 46996 clauses out of 94007 with flag 2947468/1166000
324.05/423.14	c cleaning 48003 clauses out of 96012 with flag 3070266/1215001
343.84/442.82	c cleaning 48998 clauses out of 98009 with flag 3194595/1265001
360.75/459.78	c cleaning 49998 clauses out of 100013 with flag 3325747/1316003
380.85/479.90	c cleaning 51002 clauses out of 102014 with flag 3454466/1368002
402.15/501.12	c cleaning 51996 clauses out of 104013 with flag 3587361/1421003
426.83/525.70	c cleaning 53001 clauses out of 106015 with flag 3723909/1475001
451.83/550.72	c cleaning 53999 clauses out of 108013 with flag 3860381/1530000
477.04/575.98	c cleaning 54998 clauses out of 110014 with flag 4001677/1586000
504.70/603.58	c cleaning 56003 clauses out of 112016 with flag 4145857/1643000
532.11/630.91	c cleaning 56998 clauses out of 114014 with flag 4289359/1701001
561.01/659.86	c cleaning 58001 clauses out of 116016 with flag 4438251/1760001
596.28/695.00	c cleaning 59001 clauses out of 118014 with flag 4584653/1820000
624.09/722.86	c cleaning 60001 clauses out of 120013 with flag 4737021/1881000
651.18/749.90	c cleaning 61000 clauses out of 122012 with flag 4890989/1943000
684.38/783.05	c cleaning 62004 clauses out of 124013 with flag 5050990/2006001
721.68/820.34	c cleaning 62997 clauses out of 126008 with flag 5211655/2070000
760.49/859.18	c cleaning 63997 clauses out of 128011 with flag 5376640/2135000
817.07/915.61	c cleaning 65001 clauses out of 130014 with flag 5541170/2201000
855.19/953.72	c cleaning 65999 clauses out of 132015 with flag 5718840/2268002
890.76/989.27	c cleaning 67002 clauses out of 134014 with flag 5886894/2336000
946.87/1045.32	c cleaning 68003 clauses out of 136012 with flag 6058436/2405000
1017.57/1116.03	c cleaning 69001 clauses out of 138011 with flag 6232044/2475002
1062.05/1160.40	c cleaning 70000 clauses out of 140009 with flag 6411110/2546001
1099.56/1197.98	c cleaning 70997 clauses out of 142008 with flag 6588903/2618000
1148.46/1246.77	c cleaning 71997 clauses out of 144012 with flag 6775726/2691001
1193.56/1291.87	c cleaning 73004 clauses out of 146015 with flag 6965184/2765001
1241.94/1340.13	c cleaning 74006 clauses out of 148013 with flag 7152775/2840003
1285.12/1383.35	c cleaning 74994 clauses out of 150006 with flag 7337114/2916002
1337.29/1435.42	c cleaning 76001 clauses out of 152012 with flag 7526171/2993002
1384.19/1482.33	c cleaning 77002 clauses out of 154011 with flag 7726562/3071002
1437.76/1535.87	c cleaning 77997 clauses out of 156007 with flag 7936316/3150000
1483.78/1581.83	c cleaning 79000 clauses out of 158010 with flag 8135631/3230000
1543.36/1641.31	c cleaning 80000 clauses out of 160010 with flag 8337712/3311000
1614.25/1712.23	c cleaning 81002 clauses out of 162010 with flag 8545034/3393000
1666.03/1763.96	c cleaning 81996 clauses out of 164009 with flag 8735486/3476001
1737.90/1835.78	c cleaning 83000 clauses out of 166012 with flag 8944181/3560000
1787.41/1885.21	c cleaning 83998 clauses out of 168012 with flag 9154968/3645000
1800.02/1897.80	c starts		: 3674
1800.02/1897.80	c conflicts		: 3668931
1800.02/1897.80	c decisions		: 4732862
1800.02/1897.80	c propagations		: 325565362
1800.02/1897.80	c inspects		: 30282867492
1800.02/1897.80	c shortcuts		: 0
1800.02/1897.80	c learnt literals	: 0
1800.02/1897.80	c learnt binary clauses	: 40
1800.02/1897.80	c learnt ternary clauses	: 64
1800.02/1897.80	c learnt constraints	: 3668931
1800.02/1897.80	c ignored constraints	: 0
1800.02/1897.80	c root simplifications	: 0
1800.02/1897.80	c removed literals (reason simplification)	: 0
1800.02/1897.80	c reason swapping (by a shorter reason)	: 0
1800.02/1897.80	c Calls to reduceDB	: 81
1800.02/1897.80	c Number of update (reduction) of LBD	: 663283
1800.02/1897.80	c Imported unit clauses	: 0
1800.02/1897.80	c number of reductions to clauses (during analyze)	: 0
1800.02/1897.80	c number of learned constraints concerned by reduction	: 0
1800.02/1897.80	c number of learning phase by resolution	: 0
1800.02/1897.80	c number of learning phase by cutting planes	: 0
1800.02/1897.80	c speed (assignments/second)	: 181317.10420938782
1800.02/1897.80	c non guided choices	33833
1800.02/1897.80	c timeout
1800.02/1897.83	c learnt constraints type 
1800.02/1897.83	c org.sat4j.minisat.constraints.cnf.LearntBinaryClause => 40
1800.02/1897.83	c org.sat4j.minisat.constraints.cnf.LearntWLClause => 107906
1800.02/1897.83	s UNKNOWN
1800.02/1897.83	c Total wall clock time (in seconds): 1811.595

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4117289-1467208989/watcher-4117289-1467208989 -o /tmp/evaluation-result-4117289-1467208989/solver-4117289-1467208989 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node134-1467208989-4834 --watchdog 1960 java -jar sat4j-pb.jar HOME/instance-4117289-1467208989.opb 

pid=4857
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.64 0.62 1.56 5/177 4863
/proc/meminfo: memFree=27371216/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=24328 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (runsolver) D 4857 4862 4818 0 -1 4202560 115 0 0 0 0 0 0 0 20 0 1 0 1852684 24911872 151 33554432000 4194304 4338465 140735235560224 140735235557864 273905700023 0 0 4096 24578 18446744071579943789 0 0 17 0 0 0 0 0 0
/proc/4862/statm: 6082 151 105 36 0 2655 0

[startup+0.100186 s]
/proc/loadavg: 0.64 0.62 1.56 5/177 4863
/proc/meminfo: memFree=27371216/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=24328 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (runsolver) D 4857 4862 4818 0 -1 4202560 115 0 0 0 0 0 0 0 20 0 1 0 1852684 24911872 151 33554432000 4194304 4338465 140735235560224 140735235557864 273905700023 0 0 4096 24578 18446744072101406084 0 0 17 0 0 0 9 0 0
/proc/4862/statm: 6082 151 105 36 0 2655 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 24328

[startup+0.200293 s]
/proc/loadavg: 0.64 0.62 1.56 5/177 4863
/proc/meminfo: memFree=27371216/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=24328 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (runsolver) D 4857 4862 4818 0 -1 4202560 123 0 0 0 0 0 0 0 20 0 1 0 1852684 24911872 159 33554432000 4194304 4338465 140735235560224 140735235557416 273905511863 0 0 4096 24578 18446744072100756772 0 0 17 0 0 0 9 0 0
/proc/4862/statm: 6082 159 113 36 0 2655 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 24328

[startup+0.300309 s]
/proc/loadavg: 0.64 0.62 1.56 5/177 4863
/proc/meminfo: memFree=27371216/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=24328 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (runsolver) D 4857 4862 4818 0 -1 4202560 123 0 0 0 0 0 0 0 20 0 1 0 1852684 24911872 159 33554432000 4194304 4338465 140735235560224 140735235557416 273905511863 0 0 4096 24578 18446744072100756772 0 0 17 0 0 0 9 0 0
/proc/4862/statm: 6082 159 113 36 0 2655 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 24328

[startup+0.700248 s]
/proc/loadavg: 0.64 0.62 1.56 5/177 4863
/proc/meminfo: memFree=27371216/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=272 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (java) D 4857 4862 4818 0 -1 4202496 157 0 1 0 0 0 0 0 20 0 1 0 1852684 278528 33 33554432000 1073741824 1073778376 140733625105728 140733625102904 273896533287 0 0 4096 0 18446744072100756772 0 0 17 2 0 0 17 0 0
/proc/4862/statm: 68 33 25 9 0 25 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 272

[startup+1.50025 s]
/proc/loadavg: 0.64 0.62 1.56 2/179 4865
/proc/meminfo: memFree=27369936/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=272 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (java) D 4857 4862 4818 0 -1 4202496 157 0 1 0 0 0 0 0 20 0 1 0 1852684 278528 33 33554432000 1073741824 1073778376 140733625105728 140733625102904 273896533287 0 0 4096 0 18446744072100756772 0 0 17 2 0 0 17 0 0
/proc/4862/statm: 68 33 25 9 0 25 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 272

[startup+3.10024 s]
/proc/loadavg: 0.75 0.64 1.56 2/179 4865
/proc/meminfo: memFree=27369208/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=20596 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (java) D 4857 4862 4818 0 -1 4202496 532 0 2 0 0 0 0 0 20 0 1 0 1852684 21090304 186 33554432000 1073741824 1073778376 140736286836112 140736286824712 273896537672 0 0 4096 0 18446744071579943789 0 0 17 4 0 0 26 0 0
/proc/4862/statm: 5149 186 143 9 0 71 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 20596
heavy processes:
  %CPU=36 pid=1832 uid=0 cmd=

[startup+6.30025 s]
/proc/loadavg: 0.75 0.64 1.56 1/179 4865
/proc/meminfo: memFree=27367348/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=23236 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (java) D 4857 4862 4818 0 -1 4202496 792 0 5 0 0 0 0 0 20 0 1 0 1852684 23793664 447 33554432000 1073741824 1073778376 140736286836112 140736286826104 273896487489 0 0 4096 0 18446744071579943789 0 0 17 4 0 0 294 0 0
/proc/4862/statm: 5809 447 340 9 0 128 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 23236
heavy processes:
  %CPU=36 pid=1832 uid=0 cmd=/usr/local/sbin/pbs_mom 

[startup+12.7003 s]
/proc/loadavg: 1.10 0.72 1.58 2/179 4865
/proc/meminfo: memFree=27361284/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=23236 CPUtime=0 cores=0,2,4,6
/proc/4862/stat : 4862 (java) D 4857 4862 4818 0 -1 4202496 1113 0 11 0 0 0 0 0 20 0 1 0 1852684 23793664 774 33554432000 1073741824 1073778376 140736286836112 140736286826104 140469505245856 0 0 4096 0 18446744071579943789 0 0 17 4 0 0 905 0 0
/proc/4862/statm: 5809 774 571 9 0 128 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 23236
heavy processes:
  %CPU=36 pid=1832 uid=0 cmd=/usr/local/sbin/pbs_mom 

[startup+25.5006 s]
/proc/loadavg: 1.24 0.76 1.58 2/197 4883
/proc/meminfo: memFree=27341828/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=9016616 CPUtime=0.02 cores=0,2,4,6
/proc/4862/stat : 4862 (java) S 4857 4862 4818 0 -1 4202496 2833 0 25 0 1 1 0 0 20 0 10 0 1852684 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140736286827248 273909055549 0 0 0 16784584 18446744073709551615 0 0 17 4 0 0 1003 0 0
/proc/4862/statm: 2254154 3479 1536 9 0 2244855 0
[pid=4862/tid=4867] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4867/stat : 4867 (java) D 4857 4862 4818 0 -1 4202560 1617 0 7 0 0 0 0 0 20 0 10 0 1853996 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469501236144 273909081357 0 4 0 16784584 18446744071579943789 0 0 -1 6 0 0 868 0 0
[pid=4862/tid=4868] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4868/stat : 4868 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469462726952 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4870] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4870/stat : 4870 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469461674152 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4871] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4871/stat : 4871 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469460621864 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4873] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4873/stat : 4873 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469459569064 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4875] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4875/stat : 4875 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469458516776 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4877] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4877/stat : 4877 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469457463976 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4878] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4878/stat : 4878 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469338106920 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4880] ppid=4857 vsize=9016616 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4880/stat : 4880 (java) S 4857 4862 4818 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 10 0 1854408 9233014784 3479 33554432000 1073741824 1073778376 140736286836112 140469337054120 273909068860 0 4 0 16784584 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 9016616
heavy processes:
  %CPU=36 pid=1832 uid=0 cmd=/usr/local/sbin/pbs_mom 

[startup+51.1007 s]
/proc/loadavg: 1.56 0.87 1.60 2/203 4890
/proc/meminfo: memFree=27339784/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=9225560 CPUtime=0.05 cores=0,2,4,6
/proc/4862/stat : 4862 (java) S 4857 4862 4818 0 -1 4202496 3113 0 25 0 3 2 0 0 20 0 13 0 1852684 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140736286827248 273909055549 0 0 0 16800971 18446744073709551615 0 0 17 4 0 0 1003 0 0
/proc/4862/statm: 2306390 3757 1705 9 0 2297091 0
[pid=4862/tid=4867] ppid=4857 vsize=9225560 CPUtime=0.03 cores=0,2,4,6
/proc/4862/task/4867/stat : 4867 (java) D 4857 4862 4818 0 -1 4202560 1872 0 7 0 2 1 0 0 20 0 13 0 1853996 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469501232728 273905696437 0 4 0 16800971 18446744072100756772 0 0 -1 4 0 0 3228 0 0
[pid=4862/tid=4868] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4868/stat : 4868 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469462726952 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4870] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4870/stat : 4870 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469461674152 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4871] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4871/stat : 4871 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469460621864 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4873] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4873/stat : 4873 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469459569064 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4875] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4875/stat : 4875 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469458516776 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4877] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4877/stat : 4877 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469457463976 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4878] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4878/stat : 4878 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469338106920 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4880] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4880/stat : 4880 (java) S 4857 4862 4818 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 13 0 1854408 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469337054120 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4884] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4884/stat : 4884 (java) S 4857 4862 4818 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 13 0 1855850 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469324855528 273909069737 0 0 0 16800971 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4886] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4886/stat : 4886 (java) S 4857 4862 4818 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 13 0 1857309 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469323801592 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4888] ppid=4857 vsize=9225560 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4888/stat : 4888 (java) S 4857 4862 4818 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 13 0 1857309 9446973440 3757 33554432000 1073741824 1073778376 140736286836112 140469322749192 273909068860 0 4 0 16800971 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 9225560
heavy processes:
  %CPU=36 pid=1832 uid=0 cmd=/usr/local/sbin/pbs_mom 

[startup+102.301 s]
/proc/loadavg: 2.21 1.16 1.65 9/215 4902
/proc/meminfo: memFree=27100744/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=9625040 CPUtime=1.31 cores=0,2,4,6
/proc/4862/stat : 4862 (java) S 4857 4862 4818 0 -1 4202496 10546 0 25 0 125 6 0 0 20 0 19 0 1852684 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140736286827248 273909055549 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 1003 0 0
/proc/4862/statm: 2406260 33552 2263 9 0 2396937 0
[pid=4862/tid=4867] ppid=4857 vsize=9625040 CPUtime=0.59 cores=0,2,4,6
/proc/4862/task/4867/stat : 4867 (java) R 4857 4862 4818 0 -1 4202560 2442 0 7 0 55 4 0 0 20 0 19 0 1853996 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469501227160 140469338225453 0 4 0 16800975 0 0 0 -1 2 0 0 7174 0 0
[pid=4862/tid=4868] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4868/stat : 4868 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469462726952 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4870] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4870/stat : 4870 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469461674152 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4871] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4871/stat : 4871 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469460621864 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4873] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4873/stat : 4873 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469459569064 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4875] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4875/stat : 4875 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469458516776 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4877] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4877/stat : 4877 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469457463976 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4878] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4878/stat : 4878 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469338106920 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4880] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4880/stat : 4880 (java) S 4857 4862 4818 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 1854408 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469337054120 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4884] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4884/stat : 4884 (java) S 4857 4862 4818 0 -1 4202560 6 0 0 0 0 0 0 0 20 0 19 0 1855850 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469324855528 273909069737 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4886] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4886/stat : 4886 (java) S 4857 4862 4818 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 33552 33554432000 1073741824 1073778376 140736286836112 140469323801592 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4888] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=4862/tid=4901] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4901/stat : 4901 (java) S 4857 4862 4818 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 1862909 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468577866664 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1624.41
Current children cumulated vsize (KiB) 9625040

[startup+1782.3 s]
/proc/loadavg: 2.24 2.18 2.10 4/215 4943
/proc/meminfo: memFree=26579132/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=9625040 CPUtime=1684.43 cores=0,2,4,6
/proc/4862/stat : 4862 (java) S 4857 4862 4818 0 -1 4202496 28954 0 25 0 168397 46 0 0 20 0 19 0 1852684 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140736286827248 273909055549 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 1003 0 0
/proc/4862/statm: 2406260 85887 2288 9 0 2396937 0
[pid=4862/tid=4867] ppid=4857 vsize=9625040 CPUtime=1675.74 cores=0,2,4,6
/proc/4862/task/4867/stat : 4867 (java) R 4857 4862 4818 0 -1 4202560 2480 0 7 0 167545 29 0 0 20 0 19 0 1853996 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469501226688 140469338814892 0 4 0 16800975 0 0 0 -1 4 0 0 7174 0 0
[pid=4862/tid=4868] ppid=4857 vsize=9625040 CPUtime=0.2 cores=0,2,4,6
/proc/4862/task/4868/stat : 4868 (java) S 4857 4862 4818 0 -1 4202560 63 0 0 0 18 2 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469462726952 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4870] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4870/stat : 4870 (java) S 4857 4862 4818 0 -1 4202560 173 0 0 0 18 3 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469461674152 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4871] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4871/stat : 4871 (java) S 4857 4862 4818 0 -1 4202560 140 0 0 0 19 2 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469460621864 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4873] ppid=4857 vsize=9625040 CPUtime=0.24 cores=0,2,4,6
/proc/4862/task/4873/stat : 4873 (java) S 4857 4862 4818 0 -1 4202560 75 0 0 0 22 2 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469459569064 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4875] ppid=4857 vsize=9625040 CPUtime=0.2 cores=0,2,4,6
/proc/4862/task/4875/stat : 4875 (java) S 4857 4862 4818 0 -1 4202560 88 0 0 0 18 2 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469458516776 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4877] ppid=4857 vsize=9625040 CPUtime=0.19 cores=0,2,4,6
/proc/4862/task/4877/stat : 4877 (java) S 4857 4862 4818 0 -1 4202560 27 0 0 0 17 2 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469457463976 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4878] ppid=4857 vsize=9625040 CPUtime=0.26 cores=0,2,4,6
/proc/4862/task/4878/stat : 4878 (java) S 4857 4862 4818 0 -1 4202560 174 0 0 0 23 3 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469338106920 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4880] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4880/stat : 4880 (java) S 4857 4862 4818 0 -1 4202560 139 0 0 0 19 2 0 0 20 0 19 0 1854408 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469337054120 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4884] ppid=4857 vsize=9625040 CPUtime=0.02 cores=0,2,4,6
/proc/4862/task/4884/stat : 4884 (java) S 4857 4862 4818 0 -1 4202560 50 0 0 0 2 0 0 0 20 0 19 0 1855850 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469324855528 273909069737 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4886] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4886/stat : 4886 (java) S 4857 4862 4818 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469323801592 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4888] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4888/stat : 4888 (java) S 4857 4862 4818 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140469322749192 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 52 0 0
[pid=4862/tid=4891] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4891/stat : 4891 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1859998 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468583131536 273909077792 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4893] ppid=4857 vsize=9625040 CPUtime=1.32 cores=0,2,4,6
/proc/4862/task/4893/stat : 4893 (java) S 4857 4862 4818 0 -1 4202560 12435 0 0 0 130 2 0 0 20 0 19 0 1859998 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468582079160 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4894] ppid=4857 vsize=9625040 CPUtime=1.05 cores=0,2,4,6
/proc/4862/task/4894/stat : 4894 (java) S 4857 4862 4818 0 -1 4202560 11767 0 0 0 103 2 0 0 20 0 19 0 1859998 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468581026360 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 53 0 0
[pid=4862/tid=4897] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4897/stat : 4897 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1859998 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468579974264 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4899] ppid=4857 vsize=9625040 CPUtime=0.64 cores=0,2,4,6
/proc/4862/task/4899/stat : 4899 (java) S 4857 4862 4818 0 -1 4202560 101 0 0 0 31 33 0 0 20 0 19 0 1859998 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468578921672 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4901] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4901/stat : 4901 (java) S 4857 4862 4818 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 1862909 9856040960 85887 33554432000 1073741824 1073778376 140736286836112 140468577866664 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1684.43
Current children cumulated vsize (KiB) 9625040

[startup+1842.3 s]
/proc/loadavg: 2.20 2.18 2.10 4/215 4945
/proc/meminfo: memFree=26559140/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=9625040 CPUtime=1744.51 cores=0,2,4,6
/proc/4862/stat : 4862 (java) S 4857 4862 4818 0 -1 4202496 28967 0 25 0 174403 48 0 0 20 0 19 0 1852684 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140736286827248 273909055549 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 1003 0 0
/proc/4862/statm: 2406260 86590 2288 9 0 2396937 0
[pid=4862/tid=4867] ppid=4857 vsize=9625040 CPUtime=1735.56 cores=0,2,4,6
/proc/4862/task/4867/stat : 4867 (java) R 4857 4862 4818 0 -1 4202560 2481 0 7 0 173526 30 0 0 20 0 19 0 1853996 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469501226688 140469338889824 0 4 0 16800975 0 0 0 -1 4 0 0 7174 0 0
[pid=4862/tid=4868] ppid=4857 vsize=9625040 CPUtime=0.22 cores=0,2,4,6
/proc/4862/task/4868/stat : 4868 (java) S 4857 4862 4818 0 -1 4202560 65 0 0 0 20 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469462726952 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4870] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4870/stat : 4870 (java) S 4857 4862 4818 0 -1 4202560 174 0 0 0 18 3 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469461674152 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4871] ppid=4857 vsize=9625040 CPUtime=0.24 cores=0,2,4,6
/proc/4862/task/4871/stat : 4871 (java) S 4857 4862 4818 0 -1 4202560 142 0 0 0 22 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469460621864 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4873] ppid=4857 vsize=9625040 CPUtime=0.25 cores=0,2,4,6
/proc/4862/task/4873/stat : 4873 (java) S 4857 4862 4818 0 -1 4202560 75 0 0 0 23 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469459569064 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4875] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4875/stat : 4875 (java) S 4857 4862 4818 0 -1 4202560 88 0 0 0 18 3 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469458516776 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4877] ppid=4857 vsize=9625040 CPUtime=0.19 cores=0,2,4,6
/proc/4862/task/4877/stat : 4877 (java) S 4857 4862 4818 0 -1 4202560 27 0 0 0 17 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469457463976 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4878] ppid=4857 vsize=9625040 CPUtime=0.26 cores=0,2,4,6
/proc/4862/task/4878/stat : 4878 (java) S 4857 4862 4818 0 -1 4202560 175 0 0 0 23 3 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469338106920 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4880] ppid=4857 vsize=9625040 CPUtime=0.23 cores=0,2,4,6
/proc/4862/task/4880/stat : 4880 (java) S 4857 4862 4818 0 -1 4202560 139 0 0 0 21 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469337054120 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4884] ppid=4857 vsize=9625040 CPUtime=0.02 cores=0,2,4,6
/proc/4862/task/4884/stat : 4884 (java) S 4857 4862 4818 0 -1 4202560 52 0 0 0 2 0 0 0 20 0 19 0 1855850 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469324855528 273909069737 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4886] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4886/stat : 4886 (java) S 4857 4862 4818 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469323801592 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4888] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4888/stat : 4888 (java) S 4857 4862 4818 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469322749192 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 52 0 0
[pid=4862/tid=4891] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4891/stat : 4891 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468583131536 273909077792 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4893] ppid=4857 vsize=9625040 CPUtime=1.32 cores=0,2,4,6
/proc/4862/task/4893/stat : 4893 (java) S 4857 4862 4818 0 -1 4202560 12435 0 0 0 130 2 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468582079160 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4894] ppid=4857 vsize=9625040 CPUtime=1.05 cores=0,2,4,6
/proc/4862/task/4894/stat : 4894 (java) S 4857 4862 4818 0 -1 4202560 11767 0 0 0 103 2 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468581026360 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 53 0 0
[pid=4862/tid=4897] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4897/stat : 4897 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468579974264 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4899] ppid=4857 vsize=9625040 CPUtime=0.66 cores=0,2,4,6
/proc/4862/task/4899/stat : 4899 (java) S 4857 4862 4818 0 -1 4202560 105 0 0 0 33 33 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468578921672 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4901] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4901/stat : 4901 (java) S 4857 4862 4818 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 1862909 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468577866664 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1744.51
Current children cumulated vsize (KiB) 9625040



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1897.8 s]
/proc/loadavg: 2.20 2.19 2.11 4/215 4946
/proc/meminfo: memFree=26539536/32872528 swapFree=1483896/1661724
[pid=4862] ppid=4857 vsize=9625040 CPUtime=1800.02 cores=0,2,4,6
/proc/4862/stat : 4862 (java) S 4857 4862 4818 0 -1 4202496 28969 0 25 0 179953 49 0 0 20 0 19 0 1852684 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140736286827248 273909055549 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 1003 0 0
/proc/4862/statm: 2406260 86590 2288 9 0 2396937 0
[pid=4862/tid=4867] ppid=4857 vsize=9625040 CPUtime=1790.92 cores=0,2,4,6
/proc/4862/task/4867/stat : 4867 (java) R 4857 4862 4818 0 -1 4202560 2481 0 7 0 179061 31 0 0 20 0 19 0 1853996 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469501226688 140469338814785 0 4 0 16800975 0 0 0 -1 4 0 0 7174 0 0
[pid=4862/tid=4868] ppid=4857 vsize=9625040 CPUtime=0.22 cores=0,2,4,6
/proc/4862/task/4868/stat : 4868 (java) S 4857 4862 4818 0 -1 4202560 65 0 0 0 20 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469462726952 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4870] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4870/stat : 4870 (java) S 4857 4862 4818 0 -1 4202560 174 0 0 0 18 3 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469461674152 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4871] ppid=4857 vsize=9625040 CPUtime=0.24 cores=0,2,4,6
/proc/4862/task/4871/stat : 4871 (java) S 4857 4862 4818 0 -1 4202560 142 0 0 0 22 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469460621864 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4873] ppid=4857 vsize=9625040 CPUtime=0.25 cores=0,2,4,6
/proc/4862/task/4873/stat : 4873 (java) S 4857 4862 4818 0 -1 4202560 75 0 0 0 23 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469459569064 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4862/tid=4875] ppid=4857 vsize=9625040 CPUtime=0.21 cores=0,2,4,6
/proc/4862/task/4875/stat : 4875 (java) S 4857 4862 4818 0 -1 4202560 88 0 0 0 18 3 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469458516776 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4877] ppid=4857 vsize=9625040 CPUtime=0.19 cores=0,2,4,6
/proc/4862/task/4877/stat : 4877 (java) S 4857 4862 4818 0 -1 4202560 27 0 0 0 17 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469457463976 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4878] ppid=4857 vsize=9625040 CPUtime=0.26 cores=0,2,4,6
/proc/4862/task/4878/stat : 4878 (java) S 4857 4862 4818 0 -1 4202560 175 0 0 0 23 3 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469338106920 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4880] ppid=4857 vsize=9625040 CPUtime=0.23 cores=0,2,4,6
/proc/4862/task/4880/stat : 4880 (java) S 4857 4862 4818 0 -1 4202560 139 0 0 0 21 2 0 0 20 0 19 0 1854408 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469337054120 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4884] ppid=4857 vsize=9625040 CPUtime=0.02 cores=0,2,4,6
/proc/4862/task/4884/stat : 4884 (java) S 4857 4862 4818 0 -1 4202560 52 0 0 0 2 0 0 0 20 0 19 0 1855850 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469324855528 273909069737 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4886] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4886/stat : 4886 (java) S 4857 4862 4818 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469323801592 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4888] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4888/stat : 4888 (java) S 4857 4862 4818 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 1857309 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140469322749192 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 52 0 0
[pid=4862/tid=4891] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4891/stat : 4891 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468583131536 273909077792 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4862/tid=4893] ppid=4857 vsize=9625040 CPUtime=1.32 cores=0,2,4,6
/proc/4862/task/4893/stat : 4893 (java) S 4857 4862 4818 0 -1 4202560 12435 0 0 0 130 2 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468582079160 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4862/tid=4894] ppid=4857 vsize=9625040 CPUtime=1.05 cores=0,2,4,6
/proc/4862/task/4894/stat : 4894 (java) S 4857 4862 4818 0 -1 4202560 11767 0 0 0 103 2 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468581026360 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 53 0 0
[pid=4862/tid=4897] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4897/stat : 4897 (java) S 4857 4862 4818 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468579974264 273909068860 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4899] ppid=4857 vsize=9625040 CPUtime=0.68 cores=0,2,4,6
/proc/4862/task/4899/stat : 4899 (java) S 4857 4862 4818 0 -1 4202560 107 0 0 0 34 34 0 0 20 0 19 0 1859998 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468578921672 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4862/tid=4901] ppid=4857 vsize=9625040 CPUtime=0 cores=0,2,4,6
/proc/4862/task/4901/stat : 4901 (java) S 4857 4862 4818 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 1862909 9856040960 86590 33554432000 1073741824 1073778376 140736286836112 140468577866664 273909069737 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 9625040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 4862 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 143

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4862 and gives
#  childrusage.ru_utime.tv_sec=1795
#  childrusage.ru_utime.tv_usec=90104
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=35842
# CPU time returned by wait4() is 1796.13
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1897.84
CPU time (s): 1800.02
CPU user time (s): 1799.53
CPU system time (s): 0.49
CPU usage (%): 94.8459
Max. virtual memory (cumulated for all children) (KiB): 9625040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.09
system time used= 1.03584
maximum resident set size= 347644
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29009
page faults= 25
swaps= 0
block input operations= 20256
block output operations= 1328
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39698
involuntary context switches= 5986

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.951 second user time and 16.8404 second system time

The end

Launcher Data 

Begin job on node134 at 2016-06-29 16:03:11
IDJOB=4117289
IDBENCH=111558
IDSOLVER=2546
FILE ID=node134/4117289-1467208989
RUNJOBID= node134-1467208989-4834
PBS_JOBID= 19997576
Free space on /tmp= 71708 MiB

SOLVER NAME= Sat4j PB 2.3.6 Resolution PB16
BENCH NAME= PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/EmployeeScheduling/normalized-oct4.5.opb
COMMAND LINE= java -jar sat4j-pb.jar BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4117289-1467208989/watcher-4117289-1467208989 -o /tmp/evaluation-result-4117289-1467208989/solver-4117289-1467208989 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node134-1467208989-4834 --watchdog 1960  java -jar sat4j-pb.jar HOME/instance-4117289-1467208989.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ea6cc84c6d68190182a9cd3413f0894a
RANDOM SEED=1623434733

node134.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 7358.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.738
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        27372768 kB
Buffers:          113760 kB
Cached:          2966684 kB
SwapCached:            0 kB
Active:           132924 kB
Inactive:        2962436 kB
Active(anon):      17572 kB
Inactive(anon):        0 kB
Active(file):     115352 kB
Inactive(file):  2962436 kB
Unevictable:     1661724 kB
Mlocked:         1483896 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:              3552 kB
Writeback:             0 kB
AnonPages:       1676820 kB
Mapped:            13248 kB
Shmem:               216 kB
Slab:             610148 kB
SReclaimable:      54228 kB
SUnreclaim:       555920 kB
KernelStack:        1408 kB
PageTables:         7256 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1762496 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341987908 kB
HardwareCorrupted:     0 kB
AnonHugePages:    180224 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71704 MiB
End job on node134 at 2016-06-29 16:34:59