Trace number 3385310

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 10312.9 1298.12

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S394483079-002-UNKNOWN.cnf
MD5SUM40e955d306a70bd3dffa8283c1221639
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark611.74
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data 

0.31/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.46	c INFO: solving HOME/instance-3385310-1305565030.cnf
0.31/0.46	c INFO: computing task features
0.49/0.67	c INFO: computed variable-clause graph statistics
0.49/0.68	c INFO: computed clause balance statistics
1.60/1.70	c INFO: computed variable balance statistics
2.11/2.27	c INFO: computed small-clause counts
2.11/2.27	c INFO: computed Horn-clause counts
2.20/2.32	c INFO: computed variable graph statistics
2.20/2.32	c INFO: collected features for HOME/instance-3385310-1305565030.cnf in 1.84 s
2.20/2.35	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
2.20/2.38	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
2.30/2.41	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
2.30/2.44	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
2.30/2.47	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
2.39/2.50	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.05)
2.39/2.53	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.39/2.57	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
794.57/101.78	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
795.35/101.84	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
796.00/101.98	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.04)
802.49/102.78	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
803.24/102.82	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.24/102.87	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
803.81/102.95	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
804.27/103.00	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1594.48/202.18	c INFO: running TNM@0 for 1552 with 4798 remaining (b = 0.19)
1595.28/202.24	c INFO: running FH@0 for 97 with 4798 remaining (b = 0.01)
1603.21/203.26	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1603.98/203.33	c INFO: running adaptg2wsat2009++@99 for 97 with 4797 remaining (b = 0.01)
2363.85/298.79	c INFO: running hybridGM3@100 for 97 with 4701 remaining (b = 0.01)
2370.98/299.66	c INFO: running hybridGM3@100 for 97 with 4700 remaining (b = 0.01)
2371.79/299.76	c INFO: running hybridGM3@98 for 97 with 4700 remaining (b = 0.01)
2372.54/299.86	c INFO: running hybridGM3@97 for 97 with 4700 remaining (b = 0.01)
2379.69/300.74	c INFO: running hybridGM3@0 for 194 with 4699 remaining (b = 0.02)
2394.80/302.65	c INFO: running hybridGM3@0 for 194 with 4697 remaining (b = 0.02)
2426.63/306.68	c INFO: running TNM@0 for 1552 with 4693 remaining (b = 0.15)
3123.54/394.17	c INFO: running hybridGM3@295 for 97 with 4606 remaining (b = 0.01)
3178.49/401.07	c INFO: running hybridGM3@295 for 97 with 4599 remaining (b = 0.01)
3179.27/401.16	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.01)
3180.07/401.26	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.01)
3931.13/495.56	c INFO: running adaptg2wsat2009++@98 for 97 with 4504 remaining (b = 0.01)
3938.27/496.45	c INFO: running gnovelty+2@0 for 97 with 4504 remaining (b = 0.01)
3947.82/497.66	c INFO: running hybridGM3@293 for 97 with 4502 remaining (b = 0.01)
3954.97/498.56	c INFO: running hybridGM3@396 for 97 with 4501 remaining (b = 0.01)
3979.79/501.66	c INFO: running iPAWS@0 for 97 with 4498 remaining (b = 0.01)
4001.94/504.49	c INFO: running hybridGM3@395 for 97 with 4496 remaining (b = 0.01)
4723.11/595.06	c INFO: running hybridGM3@390 for 97 with 4405 remaining (b = 0.01)
4738.14/596.97	c INFO: running FH@0 for 291 with 4403 remaining (b = 0.02)
4738.87/597.03	c INFO: running hybridGM3@100 for 97 with 4403 remaining (b = 0.01)
4746.83/598.01	c INFO: running hybridGM3@99 for 97 with 4402 remaining (b = 0.01)
4771.49/601.14	c INFO: running adaptg2wsat2009++@296 for 291 with 4399 remaining (b = 0.02)
4777.06/601.89	c INFO: running TNM@0 for 1455 with 4398 remaining (b = 0.11)
5465.96/688.41	c INFO: running FH@98 for 291 with 4312 remaining (b = 0.02)
5481.84/690.44	c INFO: running iPAWS@0 for 97 with 4310 remaining (b = 0.01)
5569.31/701.43	c INFO: running gnovelty+2@0 for 97 with 4299 remaining (b = 0.01)
6321.08/795.91	c INFO: running hybridGM3@0 for 194 with 4204 remaining (b = 0.01)
6368.09/801.90	c INFO: running adaptg2wsat2009++@100 for 97 with 4198 remaining (b = 0.01)
7078.35/891.20	c INFO: running adaptg2wsat2009++@393 for 194 with 4109 remaining (b = 0.01)
7093.48/893.08	c INFO: running FH@0 for 97 with 4107 remaining (b = 0.01)
7143.59/899.32	c INFO: running adaptg2wsat2009++@390 for 194 with 4101 remaining (b = 0.01)
7772.86/978.50	c INFO: running hybridGM3@0 for 194 with 4022 remaining (b = 0.01)
7892.93/993.51	c INFO: running NCVWr@0 for 485 with 4007 remaining (b = 0.03)
7982.01/1004.79	c INFO: running hybridGM3@99 for 97 with 3995 remaining (b = 0.01)
8651.79/1088.95	c INFO: running adaptg2wsat2009++@686 for 97 with 3911 remaining (b = 0.01)
8716.10/1097.08	c INFO: running iPAWS@0 for 97 with 3903 remaining (b = 0.01)
8740.77/1100.19	c INFO: running hybridGM3@296 for 194 with 3900 remaining (b = 0.01)
9338.55/1175.35	c INFO: running hybridGM3@99 for 97 with 3825 remaining (b = 0.01)
9410.06/1184.35	c INFO: running adaptg2wsat2009++@882 for 97 with 3816 remaining (b = 0.01)
9514.20/1197.50	c INFO: running FH@100 for 291 with 3803 remaining (b = 0.02)
10144.26/1276.76	c INFO: running adaptg2wsat2009++@679 for 97 with 3723 remaining (b = 0.01)
10168.08/1279.75	c INFO: running iPAWS@0 for 97 with 3720 remaining (b = 0.01)
10304.81/1296.99	c INFO: running hybridGM3@0 for 194 with 3703 remaining (b = 0.01)
10312.87/1298.07	c INFO: running TNM@0 for 1552 with 3702 remaining (b = 0.08)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385310-1305565030/watcher-3385310-1305565030 -o /tmp/evaluation-result-3385310-1305565030/solver-3385310-1305565030 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385310-1305565030.cnf -seed 893259170 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.62 1.40 0.49 1/425 29078
/proc/meminfo: memFree=16963340/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=16240 CPUtime=0 cores=0-7
/proc/29078/stat : 29078 (python) R 29076 29078 28826 0 -1 4202496 1046 0 0 0 0 0 0 0 23 0 1 0 746733668 16629760 918 33554432000 4194304 5683644 140733995880416 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29078/statm: 4060 918 381 364 0 547 0

[startup+0.075155 s]
/proc/loadavg: 4.62 1.40 0.49 1/425 29078
/proc/meminfo: memFree=16963340/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=84472 CPUtime=0.05 cores=0-7
/proc/29078/stat : 29078 (python) R 29076 29078 28826 0 -1 4202496 2398 0 0 0 4 1 0 0 23 0 1 0 746733668 86499328 2127 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284925584 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29078/statm: 21118 2127 707 364 0 1335 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84472

[startup+0.101149 s]
/proc/loadavg: 4.62 1.40 0.49 1/425 29078
/proc/meminfo: memFree=16963340/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=104232 CPUtime=0.07 cores=0-7
/proc/29078/stat : 29078 (python) R 29076 29078 28826 0 -1 4202496 3083 0 0 0 5 2 0 0 23 0 1 0 746733668 106733568 2764 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284925696 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29078/statm: 26058 2765 847 364 0 1806 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.301113 s]
/proc/loadavg: 4.62 1.40 0.49 1/425 29078
/proc/meminfo: memFree=16963340/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=187744 CPUtime=0.23 cores=0-7
/proc/29078/stat : 29078 (python) R 29076 29078 28826 0 -1 4202496 6800 934 1 0 17 6 0 0 17 0 1 0 746733668 192249856 4861 33554432000 4194304 5683644 140733995880416 18446744073709551615 224279957815 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29078/statm: 46936 4862 1381 364 0 3724 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 187744

[startup+0.701048 s]
/proc/loadavg: 4.62 1.40 0.49 1/425 29078
/proc/meminfo: memFree=16963340/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=290800 CPUtime=0.6 cores=0-7
/proc/29078/stat : 29078 (python) R 29076 29078 28826 0 -1 4202496 14009 934 1 0 52 8 0 0 17 0 1 0 746733668 297779200 10085 33554432000 4194304 5683644 140733995880416 18446744073709551615 4510800 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29078/statm: 72700 10085 1826 364 0 8624 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 290800

[startup+1.50092 s]
/proc/loadavg: 4.62 1.40 0.49 2/426 29083
/proc/meminfo: memFree=16928800/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=290800 CPUtime=1.4 cores=0-7
/proc/29078/stat : 29078 (python) R 29076 29078 28826 0 -1 4202496 14009 934 1 0 132 8 0 0 19 0 1 0 746733668 297779200 10085 33554432000 4194304 5683644 140733995880416 18446744073709551615 47090765371087 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29078/statm: 72700 10085 1826 364 0 8624 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 290800

[startup+3.10061 s]
/proc/loadavg: 4.62 1.40 0.49 2/426 29083
/proc/meminfo: memFree=16928552/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=432072 CPUtime=2.47 cores=0-7
/proc/29078/stat : 29078 (python) S 29076 29078 28826 0 -1 4202496 20294 934 1 0 237 10 0 0 21 0 9 0 746733668 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/29078/statm: 108018 8737 1891 364 0 43915 0
Current children cumulated CPU time (s) 2.47
Current children cumulated vsize (KiB) 432072
heavy processes:

[startup+6.30108 s]
/proc/loadavg: 4.97 1.53 0.53 9/450 29107
/proc/meminfo: memFree=16846256/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=432072 CPUtime=2.47 cores=0-7
/proc/29078/stat : 29078 (python) S 29076 29078 28826 0 -1 4202496 20294 934 1 0 237 10 0 0 21 0 9 0 746733668 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/29078/statm: 108018 8737 1891 364 0 43915 0
[pid=29084] ppid=29078 vsize=284984 CPUtime=0 cores=0-7
/proc/29084/stat : 29084 (python) S 29078 29078 28826 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 746733903 291823616 6899 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945935 0 0 16781312 514 11459762749127491843 0 0 17 7 0 0 0
/proc/29084/statm: 71246 6899 355 364 0 7164 0
[pid=29086] ppid=29084 vsize=1020308 CPUtime=3.94 cores=0-7
/proc/29086/stat : 29086 (gnovelty+2) R 29084 29086 29086 0 -1 4202496 1156 0 0 0 394 0 0 0 25 0 1 0 746733903 1044795392 892 33554432000 134512640 135663704 4288644592 18446744073709551615 135007680 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29086/statm: 255077 892 113 282 0 254793 0
[pid=29087] ppid=29078 vsize=295004 CPUtime=0 cores=0-7
/proc/29087/stat : 29087 (python) S 29078 29078 28826 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 746733906 302084096 7032 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 10565589865640984835 0 0 17 0 0 0 0
/proc/29087/statm: 73751 7032 349 364 0 9666 0
[pid=29089] ppid=29087 vsize=1020308 CPUtime=3.9 cores=0-7
/proc/29089/stat : 29089 (gnovelty+2) R 29087 29089 29089 0 -1 4202496 1155 0 0 0 389 1 0 0 25 0 1 0 746733906 1044795392 891 33554432000 134512640 135663704 4287031984 18446744073709551615 134544204 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29089/statm: 255077 891 113 282 0 254793 0
[pid=29090] ppid=29078 vsize=305160 CPUtime=0 cores=0-7
/proc/29090/stat : 29090 (python) S 29078 29078 28826 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 746733909 312483840 7036 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 1263243481975849216 0 0 17 1 0 0 0
/proc/29090/statm: 76290 7036 349 364 0 12202 0
[pid=29092] ppid=29090 vsize=423400 CPUtime=3.87 cores=0-7
/proc/29092/stat : 29092 (adaptg2wsat2009) R 29090 29092 29092 0 -1 4202496 2622 0 0 0 387 0 0 0 25 0 1 0 746733909 433561600 2358 33554432000 134512640 135107411 4288282288 18446744073709551615 134539327 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29092/statm: 105850 2358 59 146 0 104726 0
[pid=29093] ppid=29078 vsize=316024 CPUtime=0 cores=0-7
/proc/29093/stat : 29093 (python) S 29078 29078 28826 0 -1 4202560 751 0 0 0 0 0 0 0 18 0 1 0 746733912 323608576 7040 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 4945295167897698561 0 0 17 0 0 0 0
/proc/29093/statm: 79006 7040 349 364 0 14915 0
[pid=29095] ppid=29093 vsize=423400 CPUtime=3.84 cores=0-7
/proc/29095/stat : 29095 (adaptg2wsat2009) R 29093 29095 29095 0 -1 4202496 2624 0 0 0 384 0 0 0 25 0 1 0 746733912 433561600 2357 33554432000 134512640 135107411 4289429168 18446744073709551615 134532277 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29095/statm: 105850 2357 59 146 0 104726 0
[pid=29096] ppid=29078 vsize=325808 CPUtime=0 cores=0-7
/proc/29096/stat : 29096 (python) S 29078 29078 28826 0 -1 4202560 758 0 0 0 0 0 0 0 18 0 1 0 746733915 333627392 7044 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 4945299016188395778 0 0 17 1 0 0 0
/proc/29096/statm: 81452 7044 349 364 0 17358 0
[pid=29098] ppid=29096 vsize=423400 CPUtime=3.8 cores=0-7
/proc/29098/stat : 29098 (adaptg2wsat2009) R 29096 29098 29098 0 -1 4202496 2624 0 0 0 380 0 0 0 25 0 1 0 746733916 433561600 2357 33554432000 134512640 135107411 4290133424 18446744073709551615 134532381 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29098/statm: 105850 2357 59 146 0 104726 0
[pid=29099] ppid=29078 vsize=336064 CPUtime=0 cores=0-7
/proc/29099/stat : 29099 (python) S 29078 29078 28826 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 746733918 344129536 7048 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 4945287471316304129 0 0 17 1 0 0 0
/proc/29099/statm: 84016 7048 349 364 0 19919 0
[pid=29101] ppid=29099 vsize=1020308 CPUtime=3.72 cores=0-7
/proc/29101/stat : 29101 (gnovelty+2) R 29099 29101 29101 0 -1 4202496 1156 0 0 0 372 0 0 0 25 0 1 0 746733919 1044795392 891 33554432000 134512640 135663704 4292037936 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29101/statm: 255077 891 113 282 0 254793 0
[pid=29102] ppid=29078 vsize=411572 CPUtime=0 cores=0-7
/proc/29102/stat : 29102 (python) S 29078 29078 28826 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 746733922 421449728 7223 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 16129114579018940675 0 0 17 1 0 0 0
/proc/29102/statm: 102893 7223 348 364 0 38793 0
[pid=29104] ppid=29102 vsize=253036 CPUtime=3.72 cores=0-7
/proc/29104/stat : 29104 (FH) R 29102 29104 29104 0 -1 4202496 2492 0 0 0 372 0 0 0 25 0 1 0 746733924 259108864 2233 33554432000 134512640 134936988 4290907520 18446744073709551615 134553498 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29104/statm: 63259 2233 41 104 0 62763 0
[pid=29105] ppid=29078 vsize=421828 CPUtime=0 cores=0-7
/proc/29105/stat : 29105 (python) S 29078 29078 28826 0 -1 4202560 773 0 0 0 0 0 0 0 18 0 1 0 746733925 431951872 7196 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 16129118427309637890 0 0 17 1 0 0 0
/proc/29105/statm: 105457 7196 354 364 0 41354 0
[pid=29107] ppid=29105 vsize=423400 CPUtime=3.69 cores=0-7
/proc/29107/stat : 29107 (adaptg2wsat2009) R 29105 29107 29107 0 -1 4202496 2621 0 0 0 369 0 0 0 25 0 1 0 746733926 433561600 2358 33554432000 134512640 135107411 4289181760 18446744073709551615 134531246 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29107/statm: 105850 2358 59 146 0 104726 0
[pid=29078/tid=29085] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29085/stat : 29085 (python) S 29076 29078 28826 0 -1 4202560 25 934 0 0 0 0 0 0 21 0 9 0 746733903 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29088] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29088/stat : 29088 (python) S 29076 29078 28826 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 9 0 746733906 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 2 0 0 0
[pid=29078/tid=29091] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29091/stat : 29091 (python) S 29076 29078 28826 0 -1 4202560 24 934 0 0 0 0 0 0 19 0 9 0 746733909 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29094] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29094/stat : 29094 (python) S 29076 29078 28826 0 -1 4202560 19 934 0 0 0 0 0 0 21 0 9 0 746733912 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29097] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29097/stat : 29097 (python) S 29076 29078 28826 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 746733915 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29100] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29100/stat : 29100 (python) S 29076 29078 28826 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 9 0 746733918 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 7 0 0 0
[pid=29078/tid=29103] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29103/stat : 29103 (python) S 29076 29078 28826 0 -1 4202560 94 934 0 0 0 0 0 0 21 0 9 0 746733922 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 6 0 0 0
[pid=29078/tid=29106] ppid=29076 vsize=432072 CPUtime=0 cores=0-7
/proc/29078/task/29106/stat : 29106 (python) S 29076 29078 28826 0 -1 4202560 34 934 0 0 0 0 0 0 22 0 9 0 746733925 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 32.95
Current children cumulated vsize (KiB) 8136076

[startup+12.701 s]
/proc/loadavg: 5.22 1.63 0.57 9/450 29107
/proc/meminfo: memFree=16845544/32951124 swapFree=45193380/67111528
[pid=29078] ppid=29076 vsize=432072 CPUtime=2.47 cores=0-7
/proc/29078/stat : 29078 (python) S 29076 29078 28826 0 -1 4202496 20294 934 1 0 237 10 0 0 21 0 9 0 746733668 442441728 8737 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/29078/statm: 108018 8737 1891 364 0 43915 0
[pid=29084] ppid=29078 vsize=284984 CPUtime=0.04 cores=0-7
/proc/29084/stat : 29084 (python) S 29078 29078 28826 0 -1 4202560 899 0 0 0 2 2 0 0 18 0 1 0 746733903 291823616 6922 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945935 0 0 16781312 514 2975155319459512579 0 0 17 7 0 0 0
/proc/29084/statm: 71246 6922 378 364 0 7164 0
[pid=29086] ppid=29084 vsize=1020308 CPUtime=10.34 cores=0-7
/proc/29086/stat : 29086 (gnovelty+2) R 29084 29086 29086 0 -1 4202496 1156 0 0 0 1034 0 0 0 25 0 1 0 746733903 1044795392 892 33554432000 134512640 135663704 4288644592 18446744073709551615 134544117 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29086/statm: 255077 892 113 282 0 254793 0
[pid=29087] ppid=29078 vsize=295004 CPUtime=0.03 cores=0-7
/proc/29087/stat : 29087 (python) S 29078 29078 28826 0 -1 4202560 920 0 0 0 2 1 0 0 18 0 1 0 746733906 302084096 7055 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512579 0 0 17 0 0 0 0
/proc/29087/statm: 73751 7055 372 364 0 9666 0
[pid=29089] ppid=29087 vsize=1020308 CPUtime=10.28 cores=0-7
/proc/29089/stat : 29089 (gnovelty+2) R 29087 29089 29089 0 -1 4202496 1155 0 0 0 1027 1 0 0 25 0 1 0 746733906 1044795392 891 33554432000 134512640 135663704 4287031984 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29089/statm: 255077 891 113 282 0 254793 0
[pid=29090] ppid=29078 vsize=305160 CPUtime=0.03 cores=0-7
/proc/29090/stat : 29090 (python) S 29078 29078 28826 0 -1 4202560 917 0 0 0 1 2 0 0 18 0 1 0 746733909 312483840 7059 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512576 0 0 17 1 0 0 0
/proc/29090/statm: 76290 7059 372 364 0 12202 0
[pid=29092] ppid=29090 vsize=423400 CPUtime=10.27 cores=0-7
/proc/29092/stat : 29092 (adaptg2wsat2009) R 29090 29092 29092 0 -1 4202496 2622 0 0 0 1027 0 0 0 25 0 1 0 746733909 433561600 2358 33554432000 134512640 135107411 4288282288 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29092/statm: 105850 2358 59 146 0 104726 0
[pid=29093] ppid=29078 vsize=316024 CPUtime=0.03 cores=0-7
/proc/29093/stat : 29093 (python) S 29078 29078 28826 0 -1 4202560 926 0 0 0 2 1 0 0 18 0 1 0 746733912 323608576 7063 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512577 0 0 17 0 0 0 0
/proc/29093/statm: 79006 7063 372 364 0 14915 0
[pid=29095] ppid=29093 vsize=423400 CPUtime=10.24 cores=0-7
/proc/29095/stat : 29095 (adaptg2wsat2009) R 29093 29095 29095 0 -1 4202496 2624 0 0 0 1024 0 0 0 25 0 1 0 746733912 433561600 2357 33554432000 134512640 135107411 4289429168 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29095/statm: 105850 2357 59 146 0 104726 0
[pid=29096] ppid=29078 vsize=325808 CPUtime=0.03 cores=0-7
/proc/29096/stat : 29096 (python) S 29078 29078 28826 0 -1 4202560 956 0 0 0 1 2 0 0 18 0 1 0 746733915 333627392 7067 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512578 0 0 17 1 0 0 0
/proc/29096/statm: 81452 7067 372 364 0 17358 0
[pid=29098] ppid=29096 vsize=423400 CPUtime=10.06 cores=0-7
/proc/29098/stat : 29098 (adaptg2wsat2009) R 29096 29098 29098 0 -1 4202496 2624 0 0 0 1006 0 0 0 25 0 1 0 746733916 433561600 2357 33554432000 134512640 135107411 4290133424 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29098/statm: 105850 2357 59 146 0 104726 0
[pid=29099] ppid=29078 vsize=336064 CPUtime=0.04 cores=0-7
/proc/29099/stat : 29099 (python) S 29078 29078 28826 0 -1 4202560 968 0 0 0 2 2 0 0 18 0 1 0 746733918 344129536 7071 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512577 0 0 17 2 0 0 0
/proc/29099/statm: 84016 7071 372 364 0 19919 0
[pid=29101] ppid=29099 vsize=1020308 CPUtime=9.93 cores=0-7
/proc/29101/stat : 29101 (gnovelty+2) R 29099 29101 29101 0 -1 4202496 1156 0 0 0 993 0 0 0 25 0 1 0 746733919 1044795392 891 33554432000 134512640 135663704 4292037936 18446744073709551615 134545183 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29101/statm: 255077 891 113 282 0 254793 0
[pid=29102] ppid=29078 vsize=411572 CPUtime=0.03 cores=0-7
/proc/29102/stat : 29102 (python) S 29078 29078 28826 0 -1 4202560 813 0 0 0 1 2 0 0 18 0 1 0 746733922 421449728 7246 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512579 0 0 17 1 0 0 0

################
# More data... #
################

[pid=29185] ppid=29078 vsize=565412 CPUtime=0.37 cores=0-7
/proc/29185/stat : 29185 (python) S 29078 29078 28826 0 -1 4202560 1190 0 0 0 19 18 0 0 18 0 2 0 746783313 578981888 7491 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29185/statm: 141353 7491 406 364 0 77208 0
[pid=29187] ppid=29185 vsize=1020308 CPUtime=100.43 cores=0-7
/proc/29187/stat : 29187 (gnovelty+2) T 29185 29187 29187 0 -1 4202496 1174 0 0 0 10043 0 0 0 25 0 1 0 746783313 1044795392 892 33554432000 134512640 135663704 4294723536 18446744073709551615 134524945 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29187/statm: 255077 892 113 282 0 254793 0
[pid=29185/tid=29197] ppid=29078 vsize=565412 CPUtime=0 cores=0-7
/proc/29185/task/29197/stat : 29197 (python) S 29078 29078 28826 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 746793360 578981888 7491 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604447627129216 0 0 -1 4 0 0 0
[pid=29189] ppid=29078 vsize=575668 CPUtime=0.35 cores=0-7
/proc/29189/stat : 29189 (python) S 29078 29078 28826 0 -1 4202560 1179 0 0 0 18 17 0 0 19 0 2 0 746783834 589484032 7531 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29189/statm: 143917 7531 406 364 0 79769 0
[pid=29191] ppid=29189 vsize=335996 CPUtime=98.68 cores=0-7
/proc/29191/stat : 29191 (iPAWS) T 29189 29191 29191 0 -1 4202496 2057 0 0 0 9868 0 0 0 25 0 1 0 746783835 344059904 1774 33554432000 134512640 135114423 4293843776 18446744073709551615 134516985 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29191/statm: 83999 1774 59 147 0 83851 0
[pid=29189/tid=29198] ppid=29078 vsize=575668 CPUtime=0 cores=0-7
/proc/29189/task/29198/stat : 29198 (python) S 29078 29078 28826 0 -1 4202560 82 0 0 0 0 0 0 0 19 0 2 0 746793777 589484032 7531 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604451838297408 0 0 -1 1 0 0 0
[pid=29199] ppid=29078 vsize=585924 CPUtime=2.52 cores=0-7
/proc/29199/stat : 29199 (python) S 29078 29078 28826 0 -1 4202560 1021 0 0 0 134 118 0 0 18 0 1 0 746793857 599986176 7518 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512578 0 0 17 4 0 0 0
/proc/29199/statm: 146481 7518 379 364 0 82330 0
[pid=29201] ppid=29199 vsize=461508 CPUtime=695.43 cores=0-7
/proc/29201/stat : 29201 (TNM) R 29199 29201 29201 0 -1 4202496 2480 0 0 0 69543 0 0 0 25 0 1 0 746793858 472584192 2195 33554432000 134512640 135008748 4289665936 18446744073709551615 134529409 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29201/statm: 115377 2195 46 122 0 114277 0
[pid=29204] ppid=29078 vsize=596180 CPUtime=0.39 cores=0-7
/proc/29204/stat : 29204 (python) S 29078 29078 28826 0 -1 4202560 1189 0 0 0 17 22 0 0 19 0 2 0 746802712 610488320 7563 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29204/statm: 149045 7563 400 364 0 84891 0
[pid=29206] ppid=29204 vsize=335996 CPUtime=101.11 cores=0-7
/proc/29206/stat : 29206 (iPAWS) T 29204 29206 29206 0 -1 4202496 2061 0 0 0 10111 0 0 0 25 0 1 0 746802712 344059904 1774 33554432000 134512640 135114423 4292871936 18446744073709551615 134517504 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29206/statm: 83999 1774 59 147 0 83851 0
[pid=29204/tid=29212] ppid=29078 vsize=596180 CPUtime=0 cores=0-7
/proc/29204/task/29212/stat : 29212 (python) S 29078 29078 28826 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 746813253 610488320 7563 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604442396744768 0 0 -1 7 0 0 0
[pid=29207] ppid=29078 vsize=606436 CPUtime=0.35 cores=0-7
/proc/29207/stat : 29207 (python) S 29078 29078 28826 0 -1 4202560 1185 0 0 0 17 18 0 0 19 0 2 0 746803811 620990464 7618 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29207/statm: 151609 7618 400 364 0 87452 0
[pid=29209] ppid=29207 vsize=1020308 CPUtime=99.08 cores=0-7
/proc/29209/stat : 29209 (gnovelty+2) T 29207 29209 29209 0 -1 4202496 1174 0 0 0 9908 0 0 0 25 0 1 0 746803812 1044795392 891 33554432000 134512640 135663704 4290231248 18446744073709551615 134545635 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29209/statm: 255077 891 113 282 0 254793 0
[pid=29207/tid=29216] ppid=29078 vsize=606436 CPUtime=0 cores=0-7
/proc/29207/task/29216/stat : 29216 (python) S 29078 29078 28826 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 746813852 620990464 7618 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604442742681792 0 0 -1 7 0 0 0
[pid=29213] ppid=29078 vsize=616692 CPUtime=1.83 cores=0-7
/proc/29213/stat : 29213 (python) S 29078 29078 28826 0 -1 4202560 1199 0 0 0 91 92 0 0 18 0 2 0 746813259 631492608 7610 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29213/statm: 154173 7610 400 364 0 90013 0
[pid=29215] ppid=29213 vsize=268420 CPUtime=488.28 cores=0-7
/proc/29215/stat : 29215 (hybridGM3) T 29213 29215 29215 0 -1 4202496 6199 0 0 0 48828 0 0 0 25 0 1 0 746813259 274862080 5918 33554432000 134512640 135204385 4291341792 18446744073709551615 134538524 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29215/statm: 67105 5918 63 169 0 66935 0
[pid=29213/tid=29233] ppid=29078 vsize=616692 CPUtime=0 cores=0-7
/proc/29213/task/29233/stat : 29233 (python) S 29078 29078 28826 0 -1 4202560 84 0 0 0 0 0 0 0 18 0 2 0 746834141 631492608 7610 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604442742683584 0 0 -1 7 0 0 0
[pid=29221] ppid=29078 vsize=626948 CPUtime=0.37 cores=0-7
/proc/29221/stat : 29221 (python) S 29078 29078 28826 0 -1 4202560 1210 0 0 0 19 18 0 0 19 0 2 0 746822976 641994752 7618 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29221/statm: 156737 7618 400 364 0 92574 0
[pid=29223] ppid=29221 vsize=253032 CPUtime=99.25 cores=0-7
/proc/29223/stat : 29223 (FH) T 29221 29223 29223 0 -1 4202496 2514 0 0 0 9925 0 0 0 25 0 1 0 746822977 259104768 2233 33554432000 134512640 134936988 4290956640 18446744073709551615 134554976 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29223/statm: 63258 2233 41 104 0 62762 0
[pid=29221/tid=29229] ppid=29078 vsize=626948 CPUtime=0 cores=0-7
/proc/29221/task/29229/stat : 29229 (python) S 29078 29078 28826 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 746833013 641994752 7618 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604440321914944 0 0 -1 6 0 0 0
[pid=29226] ppid=29078 vsize=637204 CPUtime=1.09 cores=0-7
/proc/29226/stat : 29226 (python) S 29078 29078 28826 0 -1 4202560 1250 0 0 0 59 50 0 0 18 0 2 0 746831518 652496896 7686 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29226/statm: 159301 7686 406 364 0 95135 0
[pid=29228] ppid=29226 vsize=268424 CPUtime=295.62 cores=0-7
/proc/29228/stat : 29228 (hybridGM3) T 29226 29228 29228 0 -1 4202496 6221 0 0 0 29561 1 0 0 25 0 1 0 746831519 274866176 5918 33554432000 134512640 135204385 4291873680 18446744073709551615 134537717 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29228/statm: 67106 5918 63 169 0 66936 0
[pid=29226/tid=29241] ppid=29078 vsize=637204 CPUtime=0 cores=0-7
/proc/29226/task/29241/stat : 29241 (python) S 29078 29078 28826 0 -1 4202560 88 0 0 0 0 0 0 0 18 0 2 0 746851197 652496896 7686 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604440773146624 0 0 -1 6 0 0 0
[pid=29230] ppid=29078 vsize=647460 CPUtime=1.11 cores=0-7
/proc/29230/stat : 29230 (python) S 29078 29078 28826 0 -1 4202560 1058 0 0 0 54 57 0 0 18 0 1 0 746833019 662999040 7616 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512577 0 0 17 4 0 0 0
/proc/29230/statm: 161865 7616 378 364 0 97696 0
[pid=29232] ppid=29230 vsize=423316 CPUtime=304.41 cores=0-7
/proc/29232/stat : 29232 (NCVWr) R 29230 29232 29232 0 -1 4202496 2555 0 0 0 30441 0 0 0 25 0 1 0 746833019 433475584 2267 33554432000 134512640 135113558 4294599392 18446744073709551615 134533987 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29232/statm: 105829 2267 58 147 0 104704 0
[pid=29236] ppid=29078 vsize=657716 CPUtime=0.37 cores=0-7
/proc/29236/stat : 29236 (python) S 29078 29078 28826 0 -1 4202560 1267 0 0 0 20 17 0 0 19 0 2 0 746843376 673501184 7714 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29236/statm: 164429 7714 407 364 0 100257 0
[pid=29238] ppid=29236 vsize=335996 CPUtime=100.28 cores=0-7
/proc/29238/stat : 29238 (iPAWS) T 29236 29238 29238 0 -1 4202496 2057 0 0 0 10028 0 0 0 25 0 1 0 746843376 344059904 1773 33554432000 134512640 135114423 4289506304 18446744073709551615 134546972 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29238/statm: 83999 1773 59 147 0 83851 0
[pid=29236/tid=29244] ppid=29078 vsize=657716 CPUtime=0 cores=0-7
/proc/29236/task/29244/stat : 29244 (python) S 29078 29078 28826 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 746853412 673501184 7714 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 514 18446604446990945280 0 0 -1 0 0 0 0
[pid=29247] ppid=29078 vsize=667972 CPUtime=0.06 cores=0-7
/proc/29247/stat : 29247 (python) S 29078 29078 28826 0 -1 4202560 1072 0 0 0 4 2 0 0 18 0 1 0 746861643 684003328 7662 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 2975155319459512579 0 0 17 4 0 0 0
/proc/29247/statm: 166993 7662 379 364 0 102818 0
[pid=29249] ppid=29247 vsize=335996 CPUtime=17.89 cores=0-7
/proc/29249/stat : 29249 (iPAWS) R 29247 29249 29249 0 -1 4202496 2062 0 0 0 1789 0 0 0 25 0 1 0 746861643 344059904 1774 33554432000 134512640 135114423 4290340000 18446744073709551615 134516669 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29249/statm: 83999 1774 59 147 0 83851 0
[pid=29250] ppid=29078 vsize=678228 CPUtime=0 cores=0-7
/proc/29250/stat : 29250 (python) S 29078 29078 28826 0 -1 4202560 968 0 0 0 0 0 0 0 19 0 1 0 746863367 694505472 7738 33554432000 4194304 5683644 140733995880416 18446744073709551615 224284945990 0 0 16781312 514 4948985678676361215 0 0 17 4 0 0 0
/proc/29250/statm: 169557 7738 355 364 0 105379 0
[pid=29252] ppid=29250 vsize=268420 CPUtime=0.9 cores=0-7
/proc/29252/stat : 29252 (hybridGM3) R 29250 29252 29252 0 -1 4202496 6211 0 0 0 89 1 0 0 23 0 1 0 746863367 274862080 5919 33554432000 134512640 135204385 4289733616 18446744073709551615 134538395 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29252/statm: 67105 5919 63 169 0 66935 0
[pid=29078/tid=29085] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29085/stat : 29085 (python) S 29076 29078 28826 0 -1 4202560 25 934 0 0 0 0 0 0 21 0 34 0 746733903 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29088] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29088/stat : 29088 (python) S 29076 29078 28826 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 34 0 746733906 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 2 0 0 0
[pid=29078/tid=29091] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29091/stat : 29091 (python) S 29076 29078 28826 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 34 0 746733909 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29094] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29094/stat : 29094 (python) S 29076 29078 28826 0 -1 4202560 25 934 0 0 0 0 0 0 18 0 34 0 746733912 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29097] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29097/stat : 29097 (python) S 29076 29078 28826 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 34 0 746733915 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29100] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29100/stat : 29100 (python) S 29076 29078 28826 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 34 0 746733918 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 7 0 0 0
[pid=29078/tid=29103] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29103/stat : 29103 (python) S 29076 29078 28826 0 -1 4202560 101 934 0 0 0 0 0 0 18 0 34 0 746733922 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 6 0 0 0
[pid=29078/tid=29106] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29106/stat : 29106 (python) S 29076 29078 28826 0 -1 4202560 64 934 0 0 0 0 0 0 18 0 34 0 746733925 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29112] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29112/stat : 29112 (python) S 29076 29078 28826 0 -1 4202560 42 934 0 0 0 0 0 0 18 0 34 0 746743846 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29116] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29116/stat : 29116 (python) S 29076 29078 28826 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 34 0 746743852 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29120] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29120/stat : 29120 (python) S 29076 29078 28826 0 -1 4202560 51 934 0 0 0 0 0 0 18 0 34 0 746743867 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29125] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29125/stat : 29125 (python) S 29076 29078 28826 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 34 0 746743946 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29129] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29129/stat : 29129 (python) S 29076 29078 28826 0 -1 4202560 48 934 0 0 0 0 0 0 18 0 34 0 746743950 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 0 0 0 0
[pid=29078/tid=29132] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29132/stat : 29132 (python) S 29076 29078 28826 0 -1 4202560 54 934 0 0 0 0 0 0 18 0 34 0 746743955 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29137] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29137/stat : 29137 (python) S 29076 29078 28826 0 -1 4202560 50 934 0 0 0 0 0 0 18 0 34 0 746743963 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29140] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29140/stat : 29140 (python) S 29076 29078 28826 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 746743969 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 3 0 0 0
[pid=29078/tid=29147] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29147/stat : 29147 (python) S 29076 29078 28826 0 -1 4202560 34 934 0 0 0 0 0 0 19 0 34 0 746753887 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 2 0 0 0
[pid=29078/tid=29150] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29150/stat : 29150 (python) S 29076 29078 28826 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 746753892 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 3 0 0 0
[pid=29078/tid=29172] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29172/stat : 29172 (python) S 29076 29078 28826 0 -1 4202560 50 934 0 0 0 0 0 0 18 0 34 0 746763742 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29176] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29176/stat : 29176 (python) S 29076 29078 28826 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 746763934 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 6 0 0 0
[pid=29078/tid=29179] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29179/stat : 29179 (python) S 29076 29078 28826 0 -1 4202560 38 934 0 0 0 0 0 0 20 0 34 0 746764336 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 6 0 0 0
[pid=29078/tid=29186] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29186/stat : 29186 (python) S 29076 29078 28826 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 34 0 746783313 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29190] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29190/stat : 29190 (python) S 29076 29078 28826 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 34 0 746783835 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 6 0 0 0
[pid=29078/tid=29200] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29200/stat : 29200 (python) S 29076 29078 28826 0 -1 4202560 39 934 0 0 0 0 0 0 20 0 34 0 746793857 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29205] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29205/stat : 29205 (python) S 29076 29078 28826 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 34 0 746802712 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29208] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29208/stat : 29208 (python) S 29076 29078 28826 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 34 0 746803812 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 4 0 0 0
[pid=29078/tid=29214] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29214/stat : 29214 (python) S 29076 29078 28826 0 -1 4202560 45 934 0 0 0 0 0 0 18 0 34 0 746813259 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29222] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29222/stat : 29222 (python) S 29076 29078 28826 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 34 0 746822976 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29227] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29227/stat : 29227 (python) S 29076 29078 28826 0 -1 4202560 38 934 0 0 0 0 0 0 18 0 34 0 746831518 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 4 0 0 0
[pid=29078/tid=29231] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29231/stat : 29231 (python) S 29076 29078 28826 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 34 0 746833019 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 4 0 0 0
[pid=29078/tid=29237] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29237/stat : 29237 (python) S 29076 29078 28826 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 34 0 746843376 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 4 0 0 0
[pid=29078/tid=29248] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29248/stat : 29248 (python) S 29076 29078 28826 0 -1 4202560 38 934 0 0 0 0 0 0 20 0 34 0 746861643 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 1 0 0 0
[pid=29078/tid=29251] ppid=29076 vsize=688472 CPUtime=0 cores=0-7
/proc/29078/task/29251/stat : 29251 (python) S 29076 29078 28826 0 -1 4202560 33 934 0 0 0 0 0 0 20 0 34 0 746863367 704995328 9329 33554432000 4194304 5683644 140733995880416 18446744073709551615 224296749489 0 0 16781312 2 18446604446990943488 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10312.9
Current children cumulated vsize (KiB) 32516080

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29078 and gives
#  childrusage.ru_utime.tv_sec=3393
#  childrusage.ru_utime.tv_usec=141164
#  childrusage.ru_stime.tv_sec=15
#  childrusage.ru_stime.tv_usec=884585
# CPU time returned by wait4() is 3409.03
# while last known CPU time is 10312.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1298.12
CPU time (s): 10312.9
CPU user time (s): 10294.5
CPU system time (s): 18.35
CPU usage (%): 794.448
Max. virtual memory (cumulated for all children) (KiB): 32516080

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3393.14
system time used= 15.8846
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 97389
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14949
involuntary context switches= 22190

runsolver used 15.9546 second user time and 35.8615 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-16 18:57:10
IDJOB=3385310
IDBENCH=82575
IDSOLVER=1870
FILE ID=node118/3385310-1305565030
RUNJOBID= node118-1305564964-28840
PBS_JOBID= 13350132
Free space on /tmp= 73188 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S394483079-002-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385310-1305565030/watcher-3385310-1305565030 -o /tmp/evaluation-result-3385310-1305565030/solver-3385310-1305565030 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385310-1305565030.cnf -seed 893259170 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 40e955d306a70bd3dffa8283c1221639
RANDOM SEED=893259170

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16963248 kB
Buffers:        316796 kB
Cached:        4924764 kB
SwapCached:      22068 kB
Active:       12919720 kB
Inactive:      2738216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16963248 kB
SwapTotal:    67111528 kB
SwapFree:     45193380 kB
Dirty:           33252 kB
Writeback:           0 kB
AnonPages:    10408612 kB
Mapped:          22168 kB
Slab:           160828 kB
PageTables:      98680 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 125840572 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73152 MiB
End job on node118 at 2011-05-16 19:18:50