Trace number 3321905

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7735.6 1092.4

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S1305346115-067-UNKNOWN.cnf
MD5SUM0c1f90cdbd54dc48a7f7e4333f537217
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1107.92
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.67	c INFO: solving HOME/instance-3321905-1304369308.cnf
0.36/0.67	c INFO: computing task features
0.52/0.83	c INFO: computed variable-clause graph statistics
0.52/0.83	c INFO: computed clause balance statistics
1.23/1.59	c INFO: computed variable balance statistics
1.73/2.00	c INFO: computed small-clause counts
1.73/2.00	c INFO: computed Horn-clause counts
1.73/2.03	c INFO: computed variable graph statistics
1.73/2.03	c INFO: collected features for HOME/instance-3321905-1304369308.cnf in 1.36 s
1.73/2.07	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
1.85/2.11	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.14)
1.85/2.15	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.09)
1.85/2.18	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.04/2.22	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.06)
2.04/2.26	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.05)
2.23/2.30	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.04)
2.23/2.36	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
702.26/102.42	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.03)
702.26/102.46	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
702.90/102.56	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
744.10/108.40	c INFO: running gnovelty+2@0 for 97 with 39892 remaining (b = 0.02)
827.87/120.42	c INFO: running hybridGM3@0 for 194 with 39880 remaining (b = 0.03)
869.03/126.40	c INFO: running hybridGM3@0 for 194 with 39874 remaining (b = 0.03)
954.94/138.67	c INFO: running TNM@0 for 1552 with 39862 remaining (b = 0.21)
955.55/138.73	c INFO: running adaptg2wsat2009++@0 for 97 with 39861 remaining (b = 0.02)
1402.06/202.73	c INFO: running FH@0 for 97 with 39797 remaining (b = 0.01)
1402.77/202.80	c INFO: running hybridGM3@0 for 194 with 39797 remaining (b = 0.02)
1738.75/251.04	c INFO: running adaptg2wsat2009++@0 for 97 with 39749 remaining (b = 0.01)
1779.19/256.89	c INFO: running adaptg2wsat2009++@0 for 97 with 39743 remaining (b = 0.01)
2198.13/316.95	c INFO: running hybridGM3@101 for 97 with 39683 remaining (b = 0.01)
2227.49/321.11	c INFO: running adaptg2wsat2009++@0 for 97 with 39679 remaining (b = 0.01)
2318.76/334.23	c INFO: running hybridGM3@100 for 97 with 39666 remaining (b = 0.01)
2408.12/346.97	c INFO: running hybridGM3@97 for 97 with 39653 remaining (b = 0.01)
2463.39/354.33	c INFO: running adaptg2wsat2009++@99 for 97 with 39646 remaining (b = 0.01)
2506.73/360.17	c INFO: running gnovelty+2@0 for 97 with 39640 remaining (b = 0.01)
2939.27/418.40	c INFO: running hybridGM3@0 for 194 with 39582 remaining (b = 0.02)
3093.99/440.58	c INFO: running hybridGM3@298 for 97 with 39560 remaining (b = 0.01)
3100.96/441.52	c INFO: running hybridGM3@100 for 97 with 39559 remaining (b = 0.01)
3105.90/442.24	c INFO: running hybridGM3@0 for 194 with 39558 remaining (b = 0.02)
3213.32/457.63	c INFO: running TNM@0 for 1552 with 39543 remaining (b = 0.14)
3232.08/460.32	c INFO: running adaptg2wsat2009++@99 for 97 with 39540 remaining (b = 0.01)
3359.06/478.55	c INFO: running FH@0 for 291 with 39522 remaining (b = 0.03)
3758.50/535.86	c INFO: running iPAWS@0 for 97 with 39464 remaining (b = 0.01)
3807.30/542.81	c INFO: running adaptg2wsat2009++@99 for 97 with 39457 remaining (b = 0.01)
3994.14/569.67	c INFO: running hybridGM3@0 for 194 with 39431 remaining (b = 0.02)
4372.94/624.10	c INFO: running hybridGM3@100 for 97 with 39376 remaining (b = 0.01)
4534.00/646.24	c INFO: running FH@99 for 291 with 39354 remaining (b = 0.03)
4566.23/650.85	c INFO: running hybridGM3@95 for 97 with 39349 remaining (b = 0.01)
4658.85/664.16	c INFO: running iPAWS@0 for 97 with 39336 remaining (b = 0.01)
5153.59/730.45	c INFO: running hybridGM3@0 for 194 with 39270 remaining (b = 0.02)
5306.73/752.15	c INFO: running hybridGM3@0 for 194 with 39248 remaining (b = 0.01)
5475.88/776.50	c INFO: running TNM@0 for 1552 with 39224 remaining (b = 0.11)
5572.62/790.39	c INFO: running adaptg2wsat2009++@99 for 97 with 39210 remaining (b = 0.01)
6046.80/858.45	c INFO: running FH@0 for 97 with 39142 remaining (b = 0.01)
6388.65/905.75	c INFO: running adaptg2wsat2009++@393 for 194 with 39095 remaining (b = 0.02)
6659.07/941.97	c INFO: running FH@298 for 97 with 39058 remaining (b = 0.01)
6766.26/957.22	c INFO: running hybridGM3@96 for 97 with 39043 remaining (b = 0.01)
6945.46/982.85	c INFO: running gnovelty+2@0 for 97 with 39017 remaining (b = 0.01)
6995.92/990.03	c INFO: running hybridGM3@102 for 97 with 39010 remaining (b = 0.01)
7478.94/1055.33	c INFO: running hybridGM3@0 for 194 with 38945 remaining (b = 0.01)
7501.19/1058.55	c INFO: running hybridGM3@0 for 194 with 38942 remaining (b = 0.01)
7729.17/1091.36	c INFO: running NCVWr@0 for 485 with 38909 remaining (b = 0.03)
7735.60/1092.36	c INFO: running iPAWS@0 for 97 with 38908 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321905-1304369308/watcher-3321905-1304369308 -o /tmp/evaluation-result-3321905-1304369308/solver-3321905-1304369308 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321905-1304369308.cnf -seed 172577614 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.09 9.02 8.65 2/263 8182
/proc/meminfo: memFree=17721764/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=15384 CPUtime=0 cores=0-7
/proc/8182/stat : 8182 (python) S 8180 8182 7242 0 -1 4202496 820 0 0 0 0 0 0 0 21 0 1 0 4540292 15753216 704 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880563200 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/8182/statm: 3846 704 334 364 0 333 0

[startup+0.0669979 s]
/proc/loadavg: 9.09 9.02 8.65 2/263 8182
/proc/meminfo: memFree=17721764/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=34244 CPUtime=0.04 cores=0-7
/proc/8182/stat : 8182 (python) R 8180 8182 7242 0 -1 4202496 1523 0 0 0 3 1 0 0 21 0 1 0 4540292 35065856 1359 33554432000 4194304 5683644 140737476139792 18446744073709551615 4874222 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/8182/statm: 8561 1359 448 364 0 899 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34244

[startup+0.100983 s]
/proc/loadavg: 9.09 9.02 8.65 2/263 8182
/proc/meminfo: memFree=17721764/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=89772 CPUtime=0.06 cores=0-7
/proc/8182/stat : 8182 (python) R 8180 8182 7242 0 -1 4202496 2673 0 0 0 4 2 0 0 17 0 1 0 4540292 91926528 2388 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880560997 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/8182/statm: 22443 2388 750 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89772

[startup+0.300969 s]
/proc/loadavg: 9.09 9.02 8.65 2/263 8182
/proc/meminfo: memFree=17721764/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=135752 CPUtime=0.18 cores=0-7
/proc/8182/stat : 8182 (python) S 8180 8182 7242 0 -1 4202496 5966 933 1 0 13 5 0 0 18 0 1 0 4540292 139010048 4151 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880561157 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/8182/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700866 s]
/proc/loadavg: 9.09 9.02 8.65 2/263 8182
/proc/meminfo: memFree=17721764/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=280472 CPUtime=0.42 cores=0-7
/proc/8182/stat : 8182 (python) R 8180 8182 7242 0 -1 4202496 9775 933 1 0 33 9 0 0 17 0 1 0 4540292 287203328 7455 33554432000 4194304 5683644 140737476139792 18446744073709551615 4602358 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/8182/statm: 70118 7455 1761 364 0 6042 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 280472

[startup+1.50075 s]
/proc/loadavg: 9.09 9.02 8.65 3/264 8187
/proc/meminfo: memFree=17690880/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=287584 CPUtime=1.23 cores=0-7
/proc/8182/stat : 8182 (python) R 8180 8182 7242 0 -1 4202496 12682 933 1 0 113 10 0 0 18 0 1 0 4540292 294486016 9280 33554432000 4194304 5683644 140737476139792 18446744073709551615 4528038 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/8182/statm: 71896 9280 1826 364 0 7820 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 287584

[startup+3.10039 s]
/proc/loadavg: 9.09 9.02 8.65 4/267 8190
/proc/meminfo: memFree=17691600/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=365064 CPUtime=2.07 cores=0-7
/proc/8182/stat : 8182 (python) S 8180 8182 7242 0 -1 4202496 19327 933 1 0 195 12 0 0 19 0 9 0 4540292 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/8182/statm: 91266 8232 1891 364 0 27163 0
[pid=8188] ppid=8182 vsize=283512 CPUtime=0 cores=0-7
/proc/8188/stat : 8188 (python) S 8182 8182 7242 0 -1 4202560 732 0 0 0 0 0 0 0 20 0 1 0 4540500 290316288 6582 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585231 0 0 16781312 514 1899416236882657279 0 0 17 0 0 0 0
/proc/8188/statm: 70878 6582 355 364 0 6796 0
[pid=8190] ppid=8188 vsize=1018996 CPUtime=1.01 cores=0-7
/proc/8190/stat : 8190 (gnovelty+2) R 8188 8190 8190 0 -1 4202496 966 0 0 0 101 0 0 0 25 0 1 0 4540500 1043451904 697 33554432000 134512640 135663704 4288270624 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8190/statm: 254749 697 113 282 0 254465 0
[pid=8182/tid=8189] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8189/stat : 8189 (python) S 8180 8182 7242 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 4540500 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 1667572

[startup+6.30183 s]
/proc/loadavg: 9.16 9.04 8.66 10/288 8211
/proc/meminfo: memFree=17619264/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=365064 CPUtime=2.07 cores=0-7
/proc/8182/stat : 8182 (python) S 8180 8182 7242 0 -1 4202496 19327 933 1 0 195 12 0 0 19 0 9 0 4540292 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/8182/statm: 91266 8232 1891 364 0 27163 0
[pid=8188] ppid=8182 vsize=283512 CPUtime=0 cores=0-7
/proc/8188/stat : 8188 (python) S 8182 8182 7242 0 -1 4202560 889 0 0 0 0 0 0 0 18 0 1 0 4540500 290316288 6605 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585231 0 0 16781312 514 1899416236882624769 0 0 17 0 0 0 0
/proc/8188/statm: 70878 6605 378 364 0 6796 0
[pid=8190] ppid=8188 vsize=1018996 CPUtime=4.21 cores=0-7
/proc/8190/stat : 8190 (gnovelty+2) R 8188 8190 8190 0 -1 4202496 966 0 0 0 421 0 0 0 25 0 1 0 4540500 1043451904 697 33554432000 134512640 135663704 4288270624 18446744073709551615 134525309 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8190/statm: 254749 697 113 282 0 254465 0
[pid=8191] ppid=8182 vsize=293700 CPUtime=0 cores=0-7
/proc/8191/stat : 8191 (python) S 8182 8182 7242 0 -1 4202560 893 0 0 0 0 0 0 0 18 0 1 0 4540504 300748800 6686 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 4081529828233150724 0 0 17 6 0 0 0
/proc/8191/statm: 73425 6686 372 364 0 9340 0
[pid=8193] ppid=8191 vsize=1018996 CPUtime=4.16 cores=0-7
/proc/8193/stat : 8193 (gnovelty+2) R 8191 8193 8193 0 -1 4202496 960 0 0 0 416 0 0 0 25 0 1 0 4540504 1043451904 697 33554432000 134512640 135663704 4287483088 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8193/statm: 254749 697 113 282 0 254465 0
[pid=8194] ppid=8182 vsize=303956 CPUtime=0 cores=0-7
/proc/8194/stat : 8194 (python) S 8182 8182 7242 0 -1 4202560 904 0 0 0 0 0 0 0 18 0 1 0 4540508 311250944 6690 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 10382318044843049218 0 0 17 2 0 0 0
/proc/8194/statm: 75989 6690 372 364 0 11901 0
[pid=8196] ppid=8194 vsize=421428 CPUtime=4.11 cores=0-7
/proc/8196/stat : 8196 (adaptg2wsat2009) R 8194 8196 8196 0 -1 4202496 2048 0 0 0 411 0 0 0 25 0 1 0 4540508 431542272 1782 33554432000 134512640 135107411 4293392208 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/8196/statm: 105357 1782 59 146 0 104233 0
[pid=8197] ppid=8182 vsize=314212 CPUtime=0 cores=0-7
/proc/8197/stat : 8197 (python) S 8182 8182 7242 0 -1 4202560 913 0 0 0 0 0 0 0 18 0 1 0 4540511 321753088 6694 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 4233448250331332866 0 0 17 2 0 0 0
/proc/8197/statm: 78553 6694 372 364 0 14462 0
[pid=8199] ppid=8197 vsize=421428 CPUtime=4.06 cores=0-7
/proc/8199/stat : 8199 (adaptg2wsat2009) R 8197 8199 8199 0 -1 4202496 2046 0 0 0 406 0 0 0 25 0 1 0 4540512 431542272 1782 33554432000 134512640 135107411 4288037296 18446744073709551615 134532302 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8199/statm: 105357 1782 59 146 0 104233 0
[pid=8200] ppid=8182 vsize=324468 CPUtime=0 cores=0-7
/proc/8200/stat : 8200 (python) S 8182 8182 7242 0 -1 4202560 947 0 0 0 0 0 0 0 18 0 1 0 4540515 332255232 6698 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 4233436705459241220 0 0 17 6 0 0 0
/proc/8200/statm: 81117 6698 372 364 0 17023 0
[pid=8202] ppid=8200 vsize=421428 CPUtime=4.04 cores=0-7
/proc/8202/stat : 8202 (adaptg2wsat2009) R 8200 8202 8202 0 -1 4202496 2049 0 0 0 404 0 0 0 25 0 1 0 4540515 431542272 1781 33554432000 134512640 135107411 4290296448 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8202/statm: 105357 1781 59 146 0 104233 0
[pid=8203] ppid=8182 vsize=334724 CPUtime=0 cores=0-7
/proc/8203/stat : 8203 (python) S 8182 8182 7242 0 -1 4202560 760 0 0 0 0 0 0 0 18 0 1 0 4540519 342757376 6679 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 8831756785661477122 0 0 17 1 0 0 0
/proc/8203/statm: 83681 6679 349 364 0 19584 0
[pid=8205] ppid=8203 vsize=1018996 CPUtime=2.01 cores=0-7
/proc/8205/stat : 8205 (gnovelty+2) R 8203 8205 8205 0 -1 4202496 961 0 0 0 201 0 0 0 25 0 1 0 4540521 1043451904 697 33554432000 134512640 135663704 4290076208 18446744073709551615 134545713 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/8205/statm: 254749 697 113 282 0 254465 0
[pid=8206] ppid=8182 vsize=344980 CPUtime=0 cores=0-7
/proc/8206/stat : 8206 (python) S 8182 8182 7242 0 -1 4202560 767 0 0 0 0 0 0 0 18 0 1 0 4540523 353259520 6683 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 8831752937370779905 0 0 17 1 0 0 0
/proc/8206/statm: 86245 6683 349 364 0 22145 0
[pid=8208] ppid=8206 vsize=251296 CPUtime=3.93 cores=0-7
/proc/8208/stat : 8208 (FH) R 8206 8208 8208 0 -1 4202496 1950 0 0 0 393 0 0 0 25 0 1 0 4540525 257327104 1682 33554432000 134512640 134936988 4294867408 18446744073709551615 134552495 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8208/statm: 62824 1682 41 104 0 62328 0
[pid=8209] ppid=8182 vsize=355236 CPUtime=0 cores=0-7
/proc/8209/stat : 8209 (python) S 8182 8182 7242 0 -1 4202560 803 0 0 0 0 0 0 0 18 0 1 0 4540529 363761664 6693 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 38669278488002818 0 0 17 1 0 0 0
/proc/8209/statm: 88809 6693 355 364 0 24706 0
[pid=8211] ppid=8209 vsize=421428 CPUtime=1.96 cores=0-7
/proc/8211/stat : 8211 (adaptg2wsat2009) R 8209 8211 8211 0 -1 4202496 2053 0 0 0 196 0 0 0 25 0 1 0 4540529 431542272 1781 33554432000 134512640 135107411 4289366832 18446744073709551615 134531582 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/8211/statm: 105357 1781 59 146 0 104233 0
[pid=8182/tid=8189] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8189/stat : 8189 (python) S 8180 8182 7242 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 4540500 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8192] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8192/stat : 8192 (python) S 8180 8182 7242 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 4540504 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 6 0 0 0
[pid=8182/tid=8195] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8195/stat : 8195 (python) S 8180 8182 7242 0 -1 4202560 22 933 0 0 0 0 0 0 22 0 9 0 4540508 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8198] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8198/stat : 8198 (python) S 8180 8182 7242 0 -1 4202560 20 933 0 0 0 0 0 0 24 0 9 0 4540512 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 2 0 0 0
[pid=8182/tid=8201] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8201/stat : 8201 (python) S 8180 8182 7242 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 9 0 4540515 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 6 0 0 0
[pid=8182/tid=8204] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8204/stat : 8204 (python) S 8180 8182 7242 0 -1 4202560 22 933 0 0 0 0 0 0 21 0 9 0 4540519 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8207] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8207/stat : 8207 (python) S 8180 8182 7242 0 -1 4202560 27 933 0 0 0 0 0 0 22 0 9 0 4540523 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 1 0 0 0
[pid=8182/tid=8210] ppid=8180 vsize=365064 CPUtime=0 cores=0-7
/proc/8182/task/8210/stat : 8210 (python) S 8180 8182 7242 0 -1 4202560 84 933 0 0 0 0 0 0 19 0 9 0 4540529 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 30.55
Current children cumulated vsize (KiB) 7913848

[startup+12.7017 s]
/proc/loadavg: 9.15 9.04 8.66 10/288 8211
/proc/meminfo: memFree=17618196/32950928 swapFree=67111528/67111528
[pid=8182] ppid=8180 vsize=365064 CPUtime=2.07 cores=0-7
/proc/8182/stat : 8182 (python) S 8180 8182 7242 0 -1 4202496 19327 933 1 0 195 12 0 0 19 0 9 0 4540292 373825536 8232 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/8182/statm: 91266 8232 1891 364 0 27163 0
[pid=8188] ppid=8182 vsize=283512 CPUtime=0.01 cores=0-7
/proc/8188/stat : 8188 (python) S 8182 8182 7242 0 -1 4202560 894 0 0 0 0 1 0 0 18 0 1 0 4540500 290316288 6605 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585231 0 0 16781312 514 2515577051235188993 0 0 17 0 0 0 0
/proc/8188/statm: 70878 6605 378 364 0 6796 0
[pid=8190] ppid=8188 vsize=1018996 CPUtime=10.61 cores=0-7
/proc/8190/stat : 8190 (gnovelty+2) R 8188 8190 8190 0 -1 4202496 966 0 0 0 1061 0 0 0 25 0 1 0 4540500 1043451904 697 33554432000 134512640 135663704 4288270624 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8190/statm: 254749 697 113 282 0 254465 0
[pid=8191] ppid=8182 vsize=293700 CPUtime=0.02 cores=0-7
/proc/8191/stat : 8191 (python) S 8182 8182 7242 0 -1 4202560 898 0 0 0 1 1 0 0 18 0 1 0 4540504 300748800 6686 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188996 0 0 17 6 0 0 0
/proc/8191/statm: 73425 6686 372 364 0 9340 0
[pid=8193] ppid=8191 vsize=1018996 CPUtime=10.56 cores=0-7
/proc/8193/stat : 8193 (gnovelty+2) R 8191 8193 8193 0 -1 4202496 960 0 0 0 1056 0 0 0 25 0 1 0 4540504 1043451904 697 33554432000 134512640 135663704 4287483088 18446744073709551615 134525222 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8193/statm: 254749 697 113 282 0 254465 0
[pid=8194] ppid=8182 vsize=303956 CPUtime=0.01 cores=0-7
/proc/8194/stat : 8194 (python) S 8182 8182 7242 0 -1 4202560 909 0 0 0 0 1 0 0 18 0 1 0 4540508 311250944 6690 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188994 0 0 17 2 0 0 0
/proc/8194/statm: 75989 6690 372 364 0 11901 0
[pid=8196] ppid=8194 vsize=421428 CPUtime=10.44 cores=0-7
/proc/8196/stat : 8196 (adaptg2wsat2009) R 8194 8196 8196 0 -1 4202496 2048 0 0 0 1044 0 0 0 25 0 1 0 4540508 431542272 1782 33554432000 134512640 135107411 4293392208 18446744073709551615 134531380 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/8196/statm: 105357 1782 59 146 0 104233 0
[pid=8197] ppid=8182 vsize=314212 CPUtime=0.02 cores=0-7
/proc/8197/stat : 8197 (python) S 8182 8182 7242 0 -1 4202560 915 0 0 0 1 1 0 0 18 0 1 0 4540511 321753088 6694 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188994 0 0 17 2 0 0 0
/proc/8197/statm: 78553 6694 372 364 0 14462 0
[pid=8199] ppid=8197 vsize=421428 CPUtime=10.43 cores=0-7
/proc/8199/stat : 8199 (adaptg2wsat2009) R 8197 8199 8199 0 -1 4202496 2046 0 0 0 1043 0 0 0 25 0 1 0 4540512 431542272 1782 33554432000 134512640 135107411 4288037296 18446744073709551615 134531696 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8199/statm: 105357 1782 59 146 0 104233 0
[pid=8200] ppid=8182 vsize=324468 CPUtime=0.02 cores=0-7
/proc/8200/stat : 8200 (python) S 8182 8182 7242 0 -1 4202560 950 0 0 0 1 1 0 0 18 0 1 0 4540515 332255232 6698 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188996 0 0 17 6 0 0 0
/proc/8200/statm: 81117 6698 372 364 0 17023 0
[pid=8202] ppid=8200 vsize=421428 CPUtime=10.42 cores=0-7
/proc/8202/stat : 8202 (adaptg2wsat2009) R 8200 8202 8202 0 -1 4202496 2049 0 0 0 1042 0 0 0 25 0 1 0 4540515 431542272 1781 33554432000 134512640 135107411 4290296448 18446744073709551615 134532135 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8202/statm: 105357 1781 59 146 0 104233 0
[pid=8203] ppid=8182 vsize=334724 CPUtime=0.02 cores=0-7

################
# More data... #
################

/proc/8280/stat : 8280 (python) S 8182 8182 7242 0 -1 4202560 1131 0 0 0 74 68 0 0 18 0 1 0 4586056 578994176 7121 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188998 0 0 17 0 0 0 0
/proc/8280/statm: 141356 7121 379 364 0 77211 0
[pid=8282] ppid=8280 vsize=459764 CPUtime=537.81 cores=0-7
/proc/8282/stat : 8282 (TNM) R 8280 8282 8282 0 -1 4202496 1937 0 0 0 53780 1 0 0 25 0 1 0 4586057 470798336 1652 33554432000 134512640 135008748 4289532656 18446744073709551615 134529446 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/8282/statm: 114941 1652 46 122 0 113841 0
[pid=8286] ppid=8182 vsize=575152 CPUtime=0.25 cores=0-7
/proc/8286/stat : 8286 (python) S 8182 8182 7242 0 -1 4202560 1246 0 0 0 12 13 0 0 19 0 2 0 4593879 588955648 7290 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8286/statm: 143788 7290 406 364 0 79640 0
[pid=8288] ppid=8286 vsize=335996 CPUtime=98.46 cores=0-7
/proc/8288/stat : 8288 (iPAWS) T 8286 8288 8288 0 -1 4202496 1827 0 0 0 9846 0 0 0 25 0 1 0 4593880 344059904 1547 33554432000 134512640 135114423 4288115968 18446744073709551615 134546166 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/8288/statm: 83999 1547 59 147 0 83851 0
[pid=8286/tid=8296] ppid=8182 vsize=575152 CPUtime=0 cores=0-7
/proc/8286/task/8296/stat : 8296 (python) S 8182 8182 7242 0 -1 4202560 156 0 0 0 0 0 0 0 19 0 2 0 4604908 588955648 7290 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 514 18446604471120796480 0 0 -1 0 0 0 0
[pid=8290] ppid=8182 vsize=585408 CPUtime=0.48 cores=0-7
/proc/8290/stat : 8290 (python) S 8182 8182 7242 0 -1 4202560 1200 0 0 0 26 22 0 0 19 0 2 0 4597260 599457792 7328 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8290/statm: 146352 7328 407 364 0 82201 0
[pid=8292] ppid=8290 vsize=268424 CPUtime=198.82 cores=0-7
/proc/8292/stat : 8292 (hybridGM3) T 8290 8292 8292 0 -1 4202496 5826 0 0 0 19881 1 0 0 25 0 1 0 4597260 274866176 5543 33554432000 134512640 135204385 4289858864 18446744073709551615 134537711 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8292/statm: 67106 5543 63 169 0 66936 0
[pid=8290/tid=8324] ppid=8182 vsize=585408 CPUtime=0 cores=0-7
/proc/8290/task/8324/stat : 8324 (python) S 8182 8182 7242 0 -1 4202560 97 0 0 0 0 0 0 0 19 0 2 0 4619322 599457792 7328 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 514 18446604471120794688 0 0 -1 0 0 0 0
[pid=8299] ppid=8182 vsize=595796 CPUtime=0.24 cores=0-7
/proc/8299/stat : 8299 (python) S 8182 8182 7242 0 -1 4202560 1301 0 0 0 13 11 0 0 19 0 2 0 4606709 610095104 7311 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8299/statm: 148949 7311 400 364 0 84795 0
[pid=8301] ppid=8299 vsize=335996 CPUtime=102.28 cores=0-7
/proc/8301/stat : 8301 (iPAWS) T 8299 8301 8301 0 -1 4202496 1833 0 0 0 10228 0 0 0 25 0 1 0 4606709 344059904 1547 33554432000 134512640 135114423 4287633552 18446744073709551615 134546128 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8301/statm: 83999 1547 59 147 0 83851 0
[pid=8299/tid=8319] ppid=8182 vsize=595796 CPUtime=0 cores=0-7
/proc/8299/task/8319/stat : 8319 (python) S 8182 8182 7242 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 4617933 610095104 7311 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 514 18446604469646255360 0 0 -1 0 0 0 0
[pid=8303] ppid=8182 vsize=606536 CPUtime=0.76 cores=0-7
/proc/8303/stat : 8303 (python) S 8182 8182 7242 0 -1 4202560 1283 0 0 0 41 35 0 0 18 0 2 0 4613338 621092864 7331 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/8303/statm: 151634 7331 401 364 0 87477 0
[pid=8305] ppid=8303 vsize=268424 CPUtime=296.44 cores=0-7
/proc/8305/stat : 8305 (hybridGM3) T 8303 8305 8305 0 -1 4202496 5834 0 0 0 29644 0 0 0 25 0 1 0 4613338 274866176 5544 33554432000 134512640 135204385 4289202752 18446744073709551615 134538386 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8305/statm: 67106 5544 63 169 0 66936 0
[pid=8303/tid=8332] ppid=8182 vsize=606536 CPUtime=0 cores=0-7
/proc/8303/task/8332/stat : 8332 (python) S 8182 8182 7242 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 4636004 621092864 7331 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 514 18446604470387581888 0 0 -1 3 0 0 0
[pid=8307] ppid=8182 vsize=617004 CPUtime=0.79 cores=0-7
/proc/8307/stat : 8307 (python) S 8182 8182 7242 0 -1 4202560 1314 0 0 0 42 37 0 0 18 0 2 0 4615508 631812096 7393 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/8307/statm: 154251 7393 401 364 0 90091 0
[pid=8309] ppid=8307 vsize=268420 CPUtime=292.49 cores=0-7
/proc/8309/stat : 8309 (hybridGM3) T 8307 8309 8309 0 -1 4202496 5833 0 0 0 29248 1 0 0 25 0 1 0 4615508 274862080 5543 33554432000 134512640 135204385 4287610768 18446744073709551615 134538286 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8309/statm: 67105 5543 63 169 0 66935 0
[pid=8307/tid=8338] ppid=8182 vsize=617004 CPUtime=0 cores=0-7
/proc/8307/task/8338/stat : 8338 (python) S 8182 8182 7242 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 4639285 631812096 7393 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 514 18446604462293583680 0 0 -1 2 0 0 0
[pid=8320] ppid=8182 vsize=626800 CPUtime=0.72 cores=0-7
/proc/8320/stat : 8320 (python) S 8182 8182 7242 0 -1 4202560 1140 0 0 0 40 32 0 0 18 0 1 0 4617943 641843200 7368 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188997 0 0 17 0 0 0 0
/proc/8320/statm: 156700 7368 371 364 0 92537 0
[pid=8322] ppid=8320 vsize=459764 CPUtime=286.82 cores=0-7
/proc/8322/stat : 8322 (TNM) R 8320 8322 8322 0 -1 4202496 1942 0 0 0 28682 0 0 0 25 0 1 0 4617949 470798336 1652 33554432000 134512640 135008748 4289651376 18446744073709551615 134529552 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/8322/statm: 114941 1652 46 122 0 113841 0
[pid=8326] ppid=8182 vsize=637056 CPUtime=0.29 cores=0-7
/proc/8326/stat : 8326 (python) S 8182 8182 7242 0 -1 4202560 1365 0 0 0 15 14 0 0 19 0 2 0 4626138 652345344 7522 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/8326/statm: 159264 7522 407 364 0 95098 0
[pid=8328] ppid=8326 vsize=251288 CPUtime=100.32 cores=0-7
/proc/8328/stat : 8328 (FH) T 8326 8328 8328 0 -1 4202496 1970 0 0 0 10032 0 0 0 25 0 1 0 4626138 257318912 1682 33554432000 134512640 134936988 4288278240 18446744073709551615 134553304 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8328/statm: 62822 1682 41 104 0 62326 0
[pid=8326/tid=8334] ppid=8182 vsize=637056 CPUtime=0 cores=0-7
/proc/8326/task/8334/stat : 8334 (python) S 8182 8182 7242 0 -1 4202560 215 0 0 0 0 0 0 0 19 0 2 0 4638567 652345344 7522 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 514 18446604470387582784 0 0 -1 1 0 0 0
[pid=8335] ppid=8182 vsize=647312 CPUtime=0.24 cores=0-7
/proc/8335/stat : 8335 (python) S 8182 8182 7242 0 -1 4202560 1041 0 0 0 11 13 0 0 18 0 1 0 4638577 662847488 7468 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188998 0 0 17 3 0 0 0
/proc/8335/statm: 161828 7468 379 364 0 97659 0
[pid=8337] ppid=8335 vsize=1018996 CPUtime=82.48 cores=0-7
/proc/8337/stat : 8337 (gnovelty+2) R 8335 8337 8337 0 -1 4202496 984 0 0 0 8248 0 0 0 25 0 1 0 4638578 1043451904 697 33554432000 134512640 135663704 4292915312 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/8337/statm: 254749 697 113 282 0 254465 0
[pid=8341] ppid=8182 vsize=657568 CPUtime=0.08 cores=0-7
/proc/8341/stat : 8341 (python) S 8182 8182 7242 0 -1 4202560 1048 0 0 0 4 4 0 0 18 0 1 0 4645825 673349632 7508 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188997 0 0 17 0 0 0 0
/proc/8341/statm: 164392 7508 379 364 0 100220 0
[pid=8343] ppid=8341 vsize=268424 CPUtime=18.91 cores=0-7
/proc/8343/stat : 8343 (hybridGM3) R 8341 8343 8343 0 -1 4202496 5834 0 0 0 1891 0 0 0 25 0 1 0 4645826 274866176 5545 33554432000 134512640 135204385 4294413952 18446744073709551615 134538432 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/8343/statm: 67106 5545 63 169 0 66936 0
[pid=8344] ppid=8182 vsize=667824 CPUtime=0.06 cores=0-7
/proc/8344/stat : 8344 (python) S 8182 8182 7242 0 -1 4202560 1058 0 0 0 3 3 0 0 18 0 1 0 4646147 683851776 7604 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 2515577051235188997 0 0 17 3 0 0 0
/proc/8344/statm: 166956 7604 379 364 0 102781 0
[pid=8346] ppid=8344 vsize=268424 CPUtime=33.36 cores=0-7
/proc/8346/stat : 8346 (hybridGM3) R 8344 8346 8346 0 -1 4202496 5833 0 0 0 3335 1 0 0 25 0 1 0 4646148 274866176 5545 33554432000 134512640 135204385 4291587760 18446744073709551615 134538375 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/8346/statm: 67106 5545 63 169 0 66936 0
[pid=8348] ppid=8182 vsize=678080 CPUtime=0 cores=0-7
/proc/8348/stat : 8348 (python) S 8182 8182 7242 0 -1 4202560 924 0 0 0 0 0 0 0 20 0 1 0 4649429 694353920 7545 33554432000 4194304 5683644 140737476139792 18446744073709551615 218880585286 0 0 16781312 514 5632234848560087039 0 0 17 0 0 0 0
/proc/8348/statm: 169520 7545 346 364 0 105342 0
[pid=8350] ppid=8348 vsize=414860 CPUtime=0.43 cores=0-7
/proc/8350/stat : 8350 (NCVWr) R 8348 8350 8350 0 -1 4202496 1234 0 0 0 43 0 0 0 21 0 1 0 4649429 424816640 946 33554432000 134512640 135113558 4288624352 18446744073709551615 134526366 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/8350/statm: 103715 946 55 147 0 102590 0
[pid=8182/tid=8189] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8189/stat : 8189 (python) S 8180 8182 7242 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 34 0 4540500 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8192] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8192/stat : 8192 (python) S 8180 8182 7242 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 34 0 4540504 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 6 0 0 0
[pid=8182/tid=8195] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8195/stat : 8195 (python) S 8180 8182 7242 0 -1 4202560 25 933 0 0 0 0 0 0 18 0 34 0 4540508 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8198] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8198/stat : 8198 (python) S 8180 8182 7242 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 34 0 4540512 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 2 0 0 0
[pid=8182/tid=8201] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8201/stat : 8201 (python) S 8180 8182 7242 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 34 0 4540515 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 6 0 0 0
[pid=8182/tid=8204] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8204/stat : 8204 (python) S 8180 8182 7242 0 -1 4202560 22 933 0 0 0 0 0 0 21 0 34 0 4540519 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8207] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8207/stat : 8207 (python) S 8180 8182 7242 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 34 0 4540523 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 1 0 0 0
[pid=8182/tid=8210] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8210/stat : 8210 (python) S 8180 8182 7242 0 -1 4202560 88 933 0 0 0 0 0 0 18 0 34 0 4540529 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8217] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8217/stat : 8217 (python) S 8180 8182 7242 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 4550535 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 1 0 0 0
[pid=8182/tid=8219] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8219/stat : 8219 (python) S 8180 8182 7242 0 -1 4202560 115 933 0 0 0 0 0 0 18 0 34 0 4550539 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8224] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8224/stat : 8224 (python) S 8180 8182 7242 0 -1 4202560 43 933 0 0 0 0 0 0 18 0 34 0 4550549 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8228] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8228/stat : 8228 (python) S 8180 8182 7242 0 -1 4202560 38 933 0 0 0 0 0 0 19 0 34 0 4551133 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8233] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8233/stat : 8233 (python) S 8180 8182 7242 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 34 0 4552336 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8237] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8237/stat : 8237 (python) S 8180 8182 7242 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 34 0 4552933 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8243] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8243/stat : 8243 (python) S 8180 8182 7242 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 4554160 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8245] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8245/stat : 8245 (python) S 8180 8182 7242 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 34 0 4554166 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8252] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8252/stat : 8252 (python) S 8180 8182 7242 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 34 0 4560566 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8255] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8255/stat : 8255 (python) S 8180 8182 7242 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 34 0 4560573 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8269] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8269/stat : 8269 (python) S 8180 8182 7242 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 34 0 4576310 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 0 0 0 0
[pid=8182/tid=8273] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8273/stat : 8273 (python) S 8180 8182 7242 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 4582133 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8278] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8278/stat : 8278 (python) S 8180 8182 7242 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 4584518 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8281] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8281/stat : 8281 (python) S 8180 8182 7242 0 -1 4202560 28 933 0 0 0 0 0 0 19 0 34 0 4586056 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 2 0 0 0
[pid=8182/tid=8287] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8287/stat : 8287 (python) S 8180 8182 7242 0 -1 4202560 106 933 0 0 0 0 0 0 20 0 34 0 4593880 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8291] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8291/stat : 8291 (python) S 8180 8182 7242 0 -1 4202560 39 933 0 0 0 0 0 0 19 0 34 0 4597260 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8300] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8300/stat : 8300 (python) S 8180 8182 7242 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 34 0 4606709 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8304] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8304/stat : 8304 (python) S 8180 8182 7242 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 34 0 4613338 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8308] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8308/stat : 8308 (python) S 8180 8182 7242 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 34 0 4615508 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 7 0 0 0
[pid=8182/tid=8321] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8321/stat : 8321 (python) S 8180 8182 7242 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 34 0 4617943 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 2 0 0 0
[pid=8182/tid=8327] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8327/stat : 8327 (python) S 8180 8182 7242 0 -1 4202560 180 933 0 0 0 0 0 0 19 0 34 0 4626138 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 3 0 0 0
[pid=8182/tid=8336] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8336/stat : 8336 (python) S 8180 8182 7242 0 -1 4202560 37 933 0 0 0 0 0 0 20 0 34 0 4638578 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 3 0 0 0
[pid=8182/tid=8342] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8342/stat : 8342 (python) S 8180 8182 7242 0 -1 4202560 42 933 0 0 0 0 0 0 19 0 34 0 4645826 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 3 0 0 0
[pid=8182/tid=8345] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8345/stat : 8345 (python) S 8180 8182 7242 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 4646148 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 3 0 0 0
[pid=8182/tid=8349] ppid=8180 vsize=688324 CPUtime=0 cores=0-7
/proc/8182/task/8349/stat : 8349 (python) S 8180 8182 7242 0 -1 4202560 36 933 0 0 0 0 0 0 19 0 34 0 4649429 704843776 9145 33554432000 4194304 5683644 140737476139792 18446744073709551615 218892388785 0 0 16781312 2 18446604445102038080 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 7735.6
Current children cumulated vsize (KiB) 32317252

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8182 and gives
#  childrusage.ru_utime.tv_sec=1347
#  childrusage.ru_utime.tv_usec=416161
#  childrusage.ru_stime.tv_sec=8
#  childrusage.ru_stime.tv_usec=228749
# CPU time returned by wait4() is 1355.64
# while last known CPU time is 7735.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1092.4
CPU time (s): 7735.6
CPU user time (s): 7726.05
CPU system time (s): 9.55
CPU usage (%): 708.126
Max. virtual memory (cumulated for all children) (KiB): 32317252

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1347.42
system time used= 8.22875
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 93358
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13213
involuntary context switches= 9736

runsolver used 10.4764 second user time and 23.9394 second system time

The end

Launcher Data 

Begin job on node112 at 2011-05-02 22:48:29
IDJOB=3321905
IDBENCH=82683
IDSOLVER=1712
FILE ID=node112/3321905-1304369308
RUNJOBID= node112-1304366468-7256
PBS_JOBID= 13181758
Free space on /tmp= 72388 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S1305346115-067-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321905-1304369308/watcher-3321905-1304369308 -o /tmp/evaluation-result-3321905-1304369308/solver-3321905-1304369308 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321905-1304369308.cnf -seed 172577614 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0c1f90cdbd54dc48a7f7e4333f537217
RANDOM SEED=172577614

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5180.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17722052 kB
Buffers:         82776 kB
Cached:        1371608 kB
SwapCached:          0 kB
Active:       13958852 kB
Inactive:      1108768 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17722052 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           32752 kB
Writeback:           0 kB
AnonPages:    13612644 kB
Mapped:          19088 kB
Slab:            56328 kB
PageTables:      38536 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 23838196 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72356 MiB
End job on node112 at 2011-05-02 23:06:43