Trace number 3321778

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10997.3 1386.51

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v30000-c126000-S1196935200-064-UNKNOWN.cnf
MD5SUMa5ac359cd8af4f1e83d886effb49a2a9
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark56.4894
Satisfiable
(Un)Satisfiability was proved
Number of variables30000
Number of clauses126000
Sum of the clauses size378000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3126000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.67	c INFO: solving HOME/instance-3321778-1304367088.cnf
0.36/0.67	c INFO: computing task features
0.84/1.11	c INFO: computed variable-clause graph statistics
0.84/1.13	c INFO: computed clause balance statistics
3.04/3.33	c INFO: computed variable balance statistics
4.84/5.18	c INFO: computed small-clause counts
4.84/5.19	c INFO: computed Horn-clause counts
6.04/6.36	c INFO: computed variable graph statistics
6.04/6.36	c INFO: collected features for HOME/instance-3321778-1304367088.cnf in 5.68 s
6.14/6.40	c INFO: running hybridGM3@0 for 97 with 39994 remaining (b = 0.38)
6.14/6.44	c INFO: running hybridGM3@0 for 97 with 39994 remaining (b = 0.23)
6.14/6.47	c INFO: running hybridGM3@0 for 97 with 39994 remaining (b = 0.15)
6.40/6.51	c INFO: running hybridGM3@0 for 194 with 39994 remaining (b = 0.20)
6.40/6.55	c INFO: running hybridGM3@0 for 194 with 39994 remaining (b = 0.16)
6.40/6.59	c INFO: running hybridGM3@0 for 194 with 39994 remaining (b = 0.12)
6.81/6.63	c INFO: running TNM@0 for 97 with 39994 remaining (b = 0.05)
6.81/6.67	c INFO: running hybridGM3@0 for 194 with 39994 remaining (b = 0.08)
804.75/106.58	c INFO: running hybridGM3@0 for 97 with 39894 remaining (b = 0.04)
807.87/106.92	c INFO: running hybridGM3@0 for 194 with 39893 remaining (b = 0.06)
811.38/107.48	c INFO: running hybridGM3@0 for 97 with 39893 remaining (b = 0.03)
812.07/107.54	c INFO: running hybridGM3@0 for 97 with 39893 remaining (b = 0.03)
1557.23/200.84	c INFO: running hybridGM3@99 for 97 with 39799 remaining (b = 0.03)
1564.40/201.78	c INFO: running hybridGM3@94 for 97 with 39798 remaining (b = 0.03)
1580.38/203.78	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.03)
1581.15/203.83	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.03)
1581.15/203.88	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.03)
1581.91/203.95	c INFO: running hybridGM3@100 for 97 with 39796 remaining (b = 0.03)
1620.17/208.72	c INFO: running hybridGM3@101 for 97 with 39791 remaining (b = 0.03)
2340.83/299.02	c INFO: running hybridGM3@0 for 194 with 39701 remaining (b = 0.05)
2340.83/299.08	c INFO: running hybridGM3@0 for 194 with 39701 remaining (b = 0.04)
2341.65/299.20	c INFO: running hybridGM3@0 for 194 with 39701 remaining (b = 0.03)
2364.69/302.05	c INFO: running TNM@0 for 97 with 39698 remaining (b = 0.02)
2365.45/302.11	c INFO: running hybridGM3@193 for 97 with 39698 remaining (b = 0.01)
2379.78/303.97	c INFO: running hybridGM3@291 for 97 with 39696 remaining (b = 0.01)
2382.16/304.25	c INFO: running hybridGM3@101 for 97 with 39696 remaining (b = 0.01)
2389.33/305.14	c INFO: running TNM@0 for 1940 with 39695 remaining (b = 0.22)
3125.01/397.37	c INFO: running gnovelty+2@0 for 97 with 39603 remaining (b = 0.01)
3132.27/398.25	c INFO: running hybridGM3@0 for 194 with 39602 remaining (b = 0.02)
3164.89/402.35	c INFO: running adaptg2wsat2009++@0 for 194 with 39598 remaining (b = 0.02)
3190.35/405.52	c INFO: running hybridGM3@0 for 194 with 39595 remaining (b = 0.02)
3906.85/495.45	c INFO: running hybridGM3@95 for 97 with 39505 remaining (b = 0.01)
3907.59/495.52	c INFO: running hybridGM3@95 for 97 with 39505 remaining (b = 0.01)
3915.54/496.55	c INFO: running hybridGM3@99 for 97 with 39504 remaining (b = 0.01)
3917.95/496.80	c INFO: running TNM@0 for 97 with 39503 remaining (b = 0.01)
4667.19/590.80	c INFO: running hybridGM3@292 for 97 with 39409 remaining (b = 0.01)
4667.19/590.89	c INFO: running TNM@0 for 97 with 39409 remaining (b = 0.01)
4714.18/596.75	c INFO: running hybridGM3@291 for 97 with 39403 remaining (b = 0.01)
4717.38/597.11	c INFO: running TNM@0 for 97 with 39403 remaining (b = 0.01)
4730.90/598.87	c INFO: running TNM@0 for 97 with 39401 remaining (b = 0.01)
4753.23/601.64	c INFO: running hybridGM3@99 for 97 with 39399 remaining (b = 0.01)
4763.51/602.95	c INFO: running TNM@0 for 97 with 39397 remaining (b = 0.01)
5459.21/690.23	c INFO: running hybridGM3@0 for 194 with 39310 remaining (b = 0.02)
5473.50/692.05	c INFO: running hybridGM3@391 for 97 with 39308 remaining (b = 0.01)
5474.27/692.14	c INFO: running hybridGM3@386 for 194 with 39308 remaining (b = 0.02)
5512.47/696.94	c INFO: running hybridGM3@294 for 194 with 39303 remaining (b = 0.02)
5516.52/697.43	c INFO: running TNM@196 for 1843 with 39303 remaining (b = 0.13)
5529.97/699.20	c INFO: running adaptg2wsat2009++@99 for 97 with 39301 remaining (b = 0.01)
5562.60/703.27	c INFO: running adaptg2wsat2009++@0 for 194 with 39297 remaining (b = 0.01)
6279.85/793.38	c INFO: running hybridGM3@0 for 194 with 39207 remaining (b = 0.01)
6297.32/795.57	c INFO: running adaptg2wsat2009++@0 for 194 with 39205 remaining (b = 0.01)
6998.57/883.67	c INFO: running hybridGM3@481 for 97 with 39117 remaining (b = 0.01)
7030.47/887.67	c INFO: running hybridGM3@95 for 97 with 39113 remaining (b = 0.01)
7120.37/898.93	c INFO: running hybridGM3@0 for 194 with 39101 remaining (b = 0.01)
7133.07/900.52	c INFO: running hybridGM3@391 for 97 with 39100 remaining (b = 0.01)
7757.15/978.99	c INFO: running FH@0 for 97 with 39021 remaining (b = 0.01)
7788.92/983.00	c INFO: running adaptg2wsat2009++@100 for 97 with 39017 remaining (b = 0.01)
7851.80/990.83	c INFO: running hybridGM3@96 for 97 with 39009 remaining (b = 0.01)
7854.96/991.26	c INFO: running hybridGM3@196 for 291 with 39009 remaining (b = 0.02)
7939.30/1001.86	c INFO: running adaptg2wsat2009++@191 for 97 with 38998 remaining (b = 0.01)
8564.11/1080.34	c INFO: running adaptg2wsat2009++@297 for 291 with 38920 remaining (b = 0.02)
8595.98/1084.37	c INFO: running hybridGM3@195 for 291 with 38916 remaining (b = 0.01)
8610.28/1086.18	c INFO: running TNM@0 for 97 with 38914 remaining (b = 0.00)
8676.40/1094.50	c INFO: running TNM@0 for 97 with 38906 remaining (b = 0.00)
8714.47/1099.23	c INFO: running hybridGM3@199 for 291 with 38901 remaining (b = 0.01)
9401.08/1185.54	c INFO: running TNM@0 for 97 with 38815 remaining (b = 0.00)
9475.77/1194.92	c INFO: running TNM@0 for 97 with 38805 remaining (b = 0.00)
10198.51/1285.91	c INFO: running FH@0 for 97 with 38714 remaining (b = 0.00)
10255.64/1293.09	c INFO: running hybridGM3@293 for 194 with 38707 remaining (b = 0.01)
10273.11/1295.29	c INFO: running hybridGM3@195 for 291 with 38705 remaining (b = 0.01)
10900.36/1374.18	c INFO: running adaptg2wsat2009++@399 for 194 with 38626 remaining (b = 0.01)
10948.01/1380.19	c INFO: running TNM@0 for 97 with 38620 remaining (b = 0.00)
10996.45/1386.29	c INFO: running TNM@0 for 97 with 38614 remaining (b = 0.00)
10997.33/1386.46	c INFO: running TNM@0 for 97 with 38614 remaining (b = 0.00)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321778-1304367088/watcher-3321778-1304367088 -o /tmp/evaluation-result-3321778-1304367088/solver-3321778-1304367088 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321778-1304367088.cnf -seed 358744891 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.02 6.86 3.86 2/282 10099
/proc/meminfo: memFree=8314020/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=15780 CPUtime=0 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 832 0 0 0 0 0 0 0 21 0 1 0 548307517 16158720 716 33554432000 4194304 5683644 140736300074848 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 3945 720 334 364 0 432 0

[startup+0.023665 s]
/proc/loadavg: 8.02 6.86 3.86 2/282 10099
/proc/meminfo: memFree=8314020/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=16244 CPUtime=0 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 1064 0 0 0 0 0 0 0 21 0 1 0 548307517 16633856 935 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814240000 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 4061 935 381 364 0 548 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16244

[startup+0.10066 s]
/proc/loadavg: 8.02 6.86 3.86 2/282 10099
/proc/meminfo: memFree=8314020/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=87708 CPUtime=0.06 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 2639 0 0 0 4 2 0 0 21 0 1 0 548307517 89812992 2355 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814240000 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 21927 2355 717 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300626 s]
/proc/loadavg: 8.02 6.86 3.86 2/282 10099
/proc/meminfo: memFree=8314020/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=135748 CPUtime=0.19 cores=0-7
/proc/10099/stat : 10099 (python) S 10097 10099 9896 0 -1 4202496 5965 932 1 0 13 6 0 0 17 0 1 0 548307517 139005952 4151 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/10099/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700552 s]
/proc/loadavg: 8.02 6.86 3.86 2/282 10099
/proc/meminfo: memFree=8314020/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=282676 CPUtime=0.44 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 10310 932 1 0 32 12 0 0 16 0 1 0 548307517 289460224 7990 33554432000 4194304 5683644 140736300074848 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 70669 7990 1761 364 0 6593 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 282676

[startup+1.50051 s]
/proc/loadavg: 8.02 6.86 3.86 2/283 10104
/proc/meminfo: memFree=8271728/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=307972 CPUtime=1.24 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 20253 932 1 0 111 13 0 0 17 0 1 0 548307517 315363328 14378 33554432000 4194304 5683644 140736300074848 18446744073709551615 47758462542126 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 76993 14378 1826 364 0 12917 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 307972

[startup+3.10022 s]
/proc/loadavg: 7.46 6.76 3.84 2/283 10104
/proc/meminfo: memFree=8263172/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=307972 CPUtime=2.84 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 20253 932 1 0 271 13 0 0 19 0 1 0 548307517 315363328 14378 33554432000 4194304 5683644 140736300074848 18446744073709551615 47758462550624 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 76993 14378 1826 364 0 12917 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 307972

[startup+6.30069 s]
/proc/loadavg: 7.46 6.76 3.84 2/283 10104
/proc/meminfo: memFree=8263304/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=307972 CPUtime=6.04 cores=0-7
/proc/10099/stat : 10099 (python) R 10097 10099 9896 0 -1 4202496 20260 932 1 0 590 14 0 0 25 0 1 0 548307517 315363328 14385 33554432000 4194304 5683644 140736300074848 18446744073709551615 47758494919412 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10099/statm: 76993 14385 1833 364 0 12917 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 307972

[startup+12.7015 s]
/proc/loadavg: 7.54 6.80 3.89 9/307 10128
/proc/meminfo: memFree=8011648/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=453220 CPUtime=6.41 cores=0-7
/proc/10099/stat : 10099 (python) S 10097 10099 9896 0 -1 4202496 26198 932 1 0 625 16 0 0 23 0 9 0 548307517 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/10099/statm: 113305 14051 1889 364 0 49202 0
[pid=10105] ppid=10099 vsize=305648 CPUtime=0 cores=0-7
/proc/10105/stat : 10105 (python) S 10099 10099 9896 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 548308158 312983552 12341 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260239 0 0 16781312 514 12783705590853501185 0 0 17 1 0 0 0
/proc/10105/statm: 76412 12341 376 364 0 12330 0
[pid=10107] ppid=10105 vsize=268420 CPUtime=6.29 cores=0-7
/proc/10107/stat : 10107 (hybridGM3) R 10105 10107 10107 0 -1 4202496 7612 0 0 0 628 1 0 0 25 0 1 0 548308158 274862080 7346 33554432000 134512640 135204385 4292351184 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10107/statm: 67105 7346 64 169 0 66935 0
[pid=10108] ppid=10099 vsize=315904 CPUtime=0.01 cores=0-7
/proc/10108/stat : 10108 (python) S 10099 10099 9896 0 -1 4202560 919 0 0 0 1 0 0 0 18 0 1 0 548308162 323485696 12339 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 12783701742562803971 0 0 17 7 0 0 0
/proc/10108/statm: 78976 12339 370 364 0 14891 0
[pid=10110] ppid=10108 vsize=268420 CPUtime=6.25 cores=0-7
/proc/10110/stat : 10110 (hybridGM3) R 10108 10110 10110 0 -1 4202496 7609 0 0 0 624 1 0 0 25 0 1 0 548308162 274862080 7348 33554432000 134512640 135204385 4294356800 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10110/statm: 67105 7348 64 169 0 66935 0
[pid=10111] ppid=10099 vsize=391696 CPUtime=0 cores=0-7
/proc/10111/stat : 10111 (python) S 10099 10099 9896 0 -1 4202560 786 0 0 0 0 0 0 0 18 0 1 0 548308165 401096704 12517 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 3574692626101666052 0 0 17 7 0 0 0
/proc/10111/statm: 97924 12517 371 364 0 33836 0
[pid=10113] ppid=10111 vsize=268420 CPUtime=6.21 cores=0-7
/proc/10113/stat : 10113 (hybridGM3) R 10111 10113 10113 0 -1 4202496 7599 0 0 0 620 1 0 0 25 0 1 0 548308166 274862080 7343 33554432000 134512640 135204385 4288016016 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10113/statm: 67105 7343 64 169 0 66935 0
[pid=10114] ppid=10099 vsize=401952 CPUtime=0 cores=0-7
/proc/10114/stat : 10114 (python) S 10099 10099 9896 0 -1 4202560 796 0 0 0 0 0 0 0 18 0 1 0 548308169 411598848 12473 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 3574684929520271618 0 0 17 0 0 0 0
/proc/10114/statm: 100488 12473 371 364 0 36397 0
[pid=10116] ppid=10114 vsize=268420 CPUtime=6.16 cores=0-7
/proc/10116/stat : 10116 (hybridGM3) R 10114 10116 10116 0 -1 4202496 7600 0 0 0 616 0 0 0 25 0 1 0 548308170 274862080 7344 33554432000 134512640 135204385 4292770912 18446744073709551615 134537573 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10116/statm: 67105 7344 64 169 0 66935 0
[pid=10117] ppid=10099 vsize=412208 CPUtime=0 cores=0-7
/proc/10117/stat : 10117 (python) S 10099 10099 9896 0 -1 4202560 812 0 0 0 0 0 0 0 18 0 1 0 548308173 422100992 12597 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 4158242204747268356 0 0 17 1 0 0 0
/proc/10117/statm: 103052 12597 371 364 0 38958 0
[pid=10119] ppid=10117 vsize=268428 CPUtime=6.12 cores=0-7
/proc/10119/stat : 10119 (hybridGM3) R 10117 10119 10119 0 -1 4202496 7603 0 0 0 611 1 0 0 25 0 1 0 548308174 274870272 7344 33554432000 134512640 135204385 4289615424 18446744073709551615 134546069 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10119/statm: 67107 7344 64 169 0 66937 0
[pid=10120] ppid=10099 vsize=422464 CPUtime=0 cores=0-7
/proc/10120/stat : 10120 (python) S 10099 10099 9896 0 -1 4202560 814 0 0 0 0 0 0 0 18 0 1 0 548308177 432603136 12503 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 14748404226828763392 0 0 17 1 0 0 0
/proc/10120/statm: 105616 12503 371 364 0 41519 0
[pid=10122] ppid=10120 vsize=268424 CPUtime=6 cores=0-7
/proc/10122/stat : 10122 (hybridGM3) R 10120 10122 10122 0 -1 4202496 7604 0 0 0 599 1 0 0 25 0 1 0 548308177 274866176 7344 33554432000 134512640 135204385 4288717600 18446744073709551615 134546082 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10122/statm: 67106 7344 64 169 0 66936 0
[pid=10123] ppid=10099 vsize=432720 CPUtime=0 cores=0-7
/proc/10123/stat : 10123 (python) S 10099 10099 9896 0 -1 4202560 827 0 0 0 0 0 0 0 18 0 1 0 548308181 443105280 12524 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 14748400378538066178 0 0 17 4 0 0 0
/proc/10123/statm: 108180 12524 371 364 0 44080 0
[pid=10125] ppid=10123 vsize=463080 CPUtime=5.98 cores=0-7
/proc/10125/stat : 10125 (TNM) R 10123 10125 10125 0 -1 4202496 5203 0 0 0 598 0 0 0 25 0 1 0 548308182 474193920 4942 33554432000 134512640 135008748 4292010112 18446744073709551615 134527339 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10125/statm: 115770 4942 46 122 0 114670 0
[pid=10126] ppid=10099 vsize=442976 CPUtime=0.01 cores=0-7
/proc/10126/stat : 10126 (python) S 10099 10099 9896 0 -1 4202560 870 0 0 0 0 1 0 0 18 0 1 0 548308185 453607424 12534 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 14748396530247368960 0 0 17 4 0 0 0
/proc/10126/statm: 110744 12534 376 364 0 46641 0
[pid=10128] ppid=10126 vsize=268428 CPUtime=5.97 cores=0-7
/proc/10128/stat : 10128 (hybridGM3) R 10126 10128 10128 0 -1 4202496 7613 0 0 0 597 0 0 0 25 0 1 0 548308185 274870272 7346 33554432000 134512640 135204385 4292409120 18446744073709551615 134537249 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10128/statm: 67107 7346 64 169 0 66937 0
[pid=10099/tid=10106] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10106/stat : 10106 (python) S 10097 10099 9896 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 9 0 548308158 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 2 0 0 0
[pid=10099/tid=10109] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10109/stat : 10109 (python) S 10097 10099 9896 0 -1 4202560 26 932 0 0 0 0 0 0 18 0 9 0 548308162 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 3 0 0 0
[pid=10099/tid=10112] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10112/stat : 10112 (python) S 10097 10099 9896 0 -1 4202560 90 932 0 0 0 0 0 0 19 0 9 0 548308166 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 0 0 0 0
[pid=10099/tid=10115] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10115/stat : 10115 (python) S 10097 10099 9896 0 -1 4202560 30 932 0 0 0 0 0 0 21 0 9 0 548308169 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10118] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10118/stat : 10118 (python) S 10097 10099 9896 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 9 0 548308173 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 0 0 0 0
[pid=10099/tid=10121] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10121/stat : 10121 (python) S 10097 10099 9896 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 9 0 548308177 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 7 0 0 0
[pid=10099/tid=10124] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10124/stat : 10124 (python) S 10097 10099 9896 0 -1 4202560 33 932 0 0 0 0 0 0 21 0 9 0 548308181 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10127] ppid=10097 vsize=453220 CPUtime=0 cores=0-7
/proc/10099/task/10127/stat : 10127 (python) S 10097 10099 9896 0 -1 4202560 33 932 0 0 0 0 0 0 23 0 9 0 548308185 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 55.41
Current children cumulated vsize (KiB) 5920828

[startup+25.5014 s]
/proc/loadavg: 7.61 6.84 3.93 9/307 10128
/proc/meminfo: memFree=8014424/32950928 swapFree=67111448/67111528
[pid=10099] ppid=10097 vsize=453220 CPUtime=6.41 cores=0-7
/proc/10099/stat : 10099 (python) S 10097 10099 9896 0 -1 4202496 26198 932 1 0 625 16 0 0 23 0 9 0 548307517 464097280 14051 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/10099/statm: 113305 14051 1889 364 0 49202 0
[pid=10105] ppid=10099 vsize=305648 CPUtime=0.03 cores=0-7
/proc/10105/stat : 10105 (python) S 10099 10099 9896 0 -1 4202560 909 0 0 0 1 2 0 0 18 0 1 0 548308158 312983552 12341 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260239 0 0 16781312 514 11467237774633959681 0 0 17 1 0 0 0
/proc/10105/statm: 76412 12341 376 364 0 12330 0
[pid=10107] ppid=10105 vsize=268420 CPUtime=19.08 cores=0-7
/proc/10107/stat : 10107 (hybridGM3) R 10105 10107 10107 0 -1 4202496 7616 0 0 0 1907 1 0 0 25 0 1 0 548308158 274862080 7350 33554432000 134512640 135204385 4292351184 18446744073709551615 134536737 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10107/statm: 67105 7350 64 169 0 66935 0
[pid=10108] ppid=10099 vsize=315904 CPUtime=0.04 cores=0-7
/proc/10108/stat : 10108 (python) S 10099 10099 9896 0 -1 4202560 925 0 0 0 2 2 0 0 18 0 1 0 548308162 323485696 12339 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 11467237774633959683 0 0 17 7 0 0 0
/proc/10108/statm: 78976 12339 370 364 0 14891 0
[pid=10110] ppid=10108 vsize=268420 CPUtime=19.05 cores=0-7
/proc/10110/stat : 10110 (hybridGM3) R 10108 10110 10110 0 -1 4202496 7609 0 0 0 1904 1 0 0 25 0 1 0 548308162 274862080 7348 33554432000 134512640 135204385 4294356800 18446744073709551615 134545975 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10110/statm: 67105 7348 64 169 0 66935 0
[pid=10111] ppid=10099 vsize=391696 CPUtime=0.03 cores=0-7
/proc/10111/stat : 10111 (python) S 10099 10099 9896 0 -1 4202560 788 0 0 0 1 2 0 0 18 0 1 0 548308165 401096704 12517 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 11467237774633959684 0 0 17 7 0 0 0
/proc/10111/statm: 97924 12517 371 364 0 33836 0
[pid=10113] ppid=10111 vsize=268420 CPUtime=19.01 cores=0-7
/proc/10113/stat : 10113 (hybridGM3) R 10111 10113 10113 0 -1 4202496 7600 0 0 0 1900 1 0 0 25 0 1 0 548308166 274862080 7344 33554432000 134512640 135204385 4288016016 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10113/statm: 67105 7344 64 169 0 66935 0
[pid=10114] ppid=10099 vsize=401952 CPUtime=0.04 cores=0-7
/proc/10114/stat : 10114 (python) S 10099 10099 9896 0 -1 4202560 796 0 0 0 2 2 0 0 18 0 1 0 548308169 411598848 12473 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 11467237774633959682 0 0 17 0 0 0 0
/proc/10114/statm: 100488 12473 371 364 0 36397 0
[pid=10116] ppid=10114 vsize=268420 CPUtime=18.96 cores=0-7
/proc/10116/stat : 10116 (hybridGM3) R 10114 10116 10116 0 -1 4202496 7600 0 0 0 1896 0 0 0 25 0 1 0 548308170 274862080 7344 33554432000 134512640 135204385 4292770912 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10116/statm: 67105 7344 64 169 0 66935 0
[pid=10117] ppid=10099 vsize=412208 CPUtime=0.03 cores=0-7
/proc/10117/stat : 10117 (python) S 10099 10099 9896 0 -1 4202560 813 0 0 0 2 1 0 0 18 0 1 0 548308173 422100992 12597 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 11467237774633959684 0 0 17 1 0 0 0
/proc/10117/statm: 103052 12597 371 364 0 38958 0
[pid=10119] ppid=10117 vsize=268428 CPUtime=18.89 cores=0-7
/proc/10119/stat : 10119 (hybridGM3) R 10117 10119 10119 0 -1 4202496 7603 0 0 0 1888 1 0 0 25 0 1 0 548308174 274870272 7344 33554432000 134512640 135204385 4289615424 18446744073709551615 134536986 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10119/statm: 67107 7344 64 169 0 66937 0

################
# More data... #
################

[pid=10220] ppid=10099 vsize=617328 CPUtime=0.73 cores=0-7
/proc/10220/stat : 10220 (python) S 10099 10099 9896 0 -1 4202560 1192 0 0 0 35 38 0 0 18 0 2 0 548386856 632143872 12859 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10220/statm: 154332 12859 400 364 0 90178 0
[pid=10222] ppid=10220 vsize=268424 CPUtime=292.53 cores=0-7
/proc/10222/stat : 10222 (hybridGM3) T 10220 10222 10222 0 -1 4202496 7633 0 0 0 29252 1 0 0 25 0 1 0 548386856 274866176 7350 33554432000 134512640 135204385 4290785056 18446744073709551615 134537502 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/10222/statm: 67106 7350 64 169 0 66936 0
[pid=10220/tid=10239] ppid=10099 vsize=617328 CPUtime=0 cores=0-7
/proc/10220/task/10239/stat : 10239 (python) S 10099 10099 9896 0 -1 4202560 88 0 0 0 0 0 0 0 18 0 2 0 548406591 632143872 12859 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604445398356352 0 0 -1 5 0 0 0
[pid=10223] ppid=10099 vsize=627584 CPUtime=0.74 cores=0-7
/proc/10223/stat : 10223 (python) S 10099 10099 9896 0 -1 4202560 1195 0 0 0 41 33 0 0 18 0 2 0 548387075 642646016 12806 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10223/statm: 156896 12806 401 364 0 92739 0
[pid=10225] ppid=10223 vsize=429460 CPUtime=291.51 cores=0-7
/proc/10225/stat : 10225 (adaptg2wsat2009) T 10223 10225 10225 0 -1 4202496 5428 0 0 0 29150 1 0 0 25 0 1 0 548387076 439767040 5140 33554432000 134512640 135107411 4290721728 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/10225/statm: 107365 5140 59 146 0 106241 0
[pid=10223/tid=10240] ppid=10099 vsize=627584 CPUtime=0 cores=0-7
/proc/10223/task/10240/stat : 10240 (python) S 10099 10099 9896 0 -1 4202560 90 0 0 0 0 0 0 0 18 0 2 0 548406633 642646016 12806 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604443852190912 0 0 -1 1 0 0 0
[pid=10231] ppid=10099 vsize=637840 CPUtime=0.49 cores=0-7
/proc/10231/stat : 10231 (python) S 10099 10099 9896 0 -1 4202560 1193 0 0 0 23 26 0 0 19 0 2 0 548397410 653148160 12880 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10231/statm: 159460 12880 400 364 0 95300 0
[pid=10233] ppid=10231 vsize=268420 CPUtime=194.83 cores=0-7
/proc/10233/stat : 10233 (hybridGM3) T 10231 10233 10233 0 -1 4202496 7628 0 0 0 19482 1 0 0 25 0 1 0 548397411 274862080 7346 33554432000 134512640 135204385 4286672416 18446744073709551615 134537143 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/10233/statm: 67105 7346 64 169 0 66935 0
[pid=10231/tid=10248] ppid=10099 vsize=637840 CPUtime=0 cores=0-7
/proc/10231/task/10248/stat : 10248 (python) S 10099 10099 9896 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 548416957 653148160 12880 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604449248899520 0 0 -1 6 0 0 0
[pid=10236] ppid=10099 vsize=648096 CPUtime=0.27 cores=0-7
/proc/10236/stat : 10236 (python) S 10099 10099 9896 0 -1 4202560 1211 0 0 0 13 14 0 0 19 0 2 0 548405417 663650304 12906 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10236/statm: 162024 12906 401 364 0 97861 0
[pid=10238] ppid=10236 vsize=258440 CPUtime=101.64 cores=0-7
/proc/10238/stat : 10238 (FH) T 10236 10238 10238 0 -1 4202496 5353 0 0 0 10164 0 0 0 25 0 1 0 548405418 264642560 5067 33554432000 134512640 134936988 4292065984 18446744073709551615 134552073 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/10238/statm: 64610 5067 41 104 0 64114 0
[pid=10236/tid=10243] ppid=10099 vsize=648096 CPUtime=0 cores=0-7
/proc/10236/task/10243/stat : 10243 (python) S 10099 10099 9896 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 548415944 663650304 12906 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604442856210816 0 0 -1 7 0 0 0
[pid=10244] ppid=10099 vsize=658352 CPUtime=0.25 cores=0-7
/proc/10244/stat : 10244 (python) S 10099 10099 9896 0 -1 4202560 1240 0 0 0 12 13 0 0 19 0 2 0 548416135 674152448 12919 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10244/statm: 164588 12919 406 364 0 100422 0
[pid=10246] ppid=10244 vsize=463080 CPUtime=99.15 cores=0-7
/proc/10246/stat : 10246 (TNM) T 10244 10246 10246 0 -1 4202496 5231 0 0 0 9915 0 0 0 25 0 1 0 548416136 474193920 4942 33554432000 134512640 135008748 4292489200 18446744073709551615 134527091 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/10246/statm: 115770 4942 46 122 0 114670 0
[pid=10244/tid=10254] ppid=10099 vsize=658352 CPUtime=0 cores=0-7
/proc/10244/task/10254/stat : 10254 (python) S 10099 10099 9896 0 -1 4202560 98 0 0 0 0 0 0 0 19 0 2 0 548426061 674152448 12919 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604442856211712 0 0 -1 6 0 0 0
[pid=10249] ppid=10099 vsize=668608 CPUtime=0.25 cores=0-7
/proc/10249/stat : 10249 (python) S 10099 10099 9896 0 -1 4202560 1249 0 0 0 13 12 0 0 18 0 2 0 548416968 684654592 12982 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10249/statm: 167152 12982 407 364 0 102983 0
[pid=10251] ppid=10249 vsize=463080 CPUtime=99.78 cores=0-7
/proc/10251/stat : 10251 (TNM) T 10249 10251 10251 0 -1 4202496 5229 0 0 0 9977 1 0 0 25 0 1 0 548416969 474193920 4941 33554432000 134512640 135008748 4294743984 18446744073709551615 134527693 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/10251/statm: 115770 4941 46 122 0 114670 0
[pid=10249/tid=10259] ppid=10099 vsize=668608 CPUtime=0 cores=0-7
/proc/10249/task/10259/stat : 10259 (python) S 10099 10099 9896 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 548426998 684654592 12982 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604440863752640 0 0 -1 0 0 0 0
[pid=10255] ppid=10099 vsize=678864 CPUtime=0.25 cores=0-7
/proc/10255/stat : 10255 (python) S 10099 10099 9896 0 -1 4202560 1257 0 0 0 13 12 0 0 19 0 2 0 548426072 695156736 13106 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10255/statm: 169716 13106 407 364 0 105544 0
[pid=10257] ppid=10255 vsize=463080 CPUtime=99.77 cores=0-7
/proc/10257/stat : 10257 (TNM) T 10255 10257 10257 0 -1 4202496 5230 0 0 0 9975 2 0 0 25 0 1 0 548426072 474193920 4941 33554432000 134512640 135008748 4287519872 18446744073709551615 134527045 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/10257/statm: 115770 4941 46 122 0 114670 0
[pid=10255/tid=10265] ppid=10099 vsize=678864 CPUtime=0 cores=0-7
/proc/10255/task/10265/stat : 10265 (python) S 10099 10099 9896 0 -1 4202560 97 0 0 0 0 0 0 0 19 0 2 0 548436097 695156736 13106 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604440863755328 0 0 -1 0 0 0 0
[pid=10260] ppid=10099 vsize=689120 CPUtime=0.25 cores=0-7
/proc/10260/stat : 10260 (python) S 10099 10099 9896 0 -1 4202560 1277 0 0 0 14 11 0 0 19 0 2 0 548427010 705658880 13050 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10260/statm: 172280 13050 407 364 0 108105 0
[pid=10262] ppid=10260 vsize=463080 CPUtime=99.96 cores=0-7
/proc/10262/stat : 10262 (TNM) T 10260 10262 10262 0 -1 4202496 5234 0 0 0 9995 1 0 0 25 0 1 0 548427011 474193920 4941 33554432000 134512640 135008748 4292044048 18446744073709551615 134527742 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/10262/statm: 115770 4941 46 122 0 114670 0
[pid=10260/tid=10269] ppid=10099 vsize=689120 CPUtime=0 cores=0-7
/proc/10260/task/10269/stat : 10269 (python) S 10099 10099 9896 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 548437035 705658880 13050 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604452299777856 0 0 -1 0 0 0 0
[pid=10266] ppid=10099 vsize=699376 CPUtime=0.25 cores=0-7
/proc/10266/stat : 10266 (python) S 10099 10099 9896 0 -1 4202560 1257 0 0 0 13 12 0 0 19 0 2 0 548436109 716161024 13047 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/10266/statm: 174844 13047 400 364 0 110666 0
[pid=10268] ppid=10266 vsize=258436 CPUtime=99.21 cores=0-7
/proc/10268/stat : 10268 (FH) T 10266 10268 10268 0 -1 4202496 5364 0 0 0 9920 1 0 0 25 0 1 0 548436110 264638464 5067 33554432000 134512640 134936988 4293135104 18446744073709551615 134553554 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/10268/statm: 64609 5067 41 104 0 64113 0
[pid=10266/tid=10275] ppid=10099 vsize=699376 CPUtime=0 cores=0-7
/proc/10266/task/10275/stat : 10275 (python) S 10099 10099 9896 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 548446134 716161024 13047 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 514 18446604452299776960 0 0 -1 1 0 0 0
[pid=10272] ppid=10099 vsize=709632 CPUtime=0.02 cores=0-7
/proc/10272/stat : 10272 (python) S 10099 10099 9896 0 -1 4202560 1064 0 0 0 1 1 0 0 18 0 1 0 548445537 726663168 13089 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 7790207562611130625 0 0 17 6 0 0 0
/proc/10272/statm: 177408 13089 373 364 0 113227 0
[pid=10274] ppid=10272 vsize=463080 CPUtime=6.09 cores=0-7
/proc/10274/stat : 10274 (TNM) R 10272 10274 10274 0 -1 4202496 5228 0 0 0 609 0 0 0 25 0 1 0 548445538 474193920 4941 33554432000 134512640 135008748 4293840800 18446744073709551615 134524720 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10274/statm: 115770 4941 46 122 0 114670 0
[pid=10276] ppid=10099 vsize=719888 CPUtime=0 cores=0-7
/proc/10276/stat : 10276 (python) S 10099 10099 9896 0 -1 4202560 933 0 0 0 0 0 0 0 19 0 1 0 548446147 737165312 13067 33554432000 4194304 5683644 140736300074848 18446744073709551615 251814260294 0 0 16781312 514 7790211410901860351 0 0 17 6 0 0 0
/proc/10276/statm: 179972 13067 346 364 0 115788 0
[pid=10278] ppid=10276 vsize=451320 CPUtime=0.01 cores=0-7
/proc/10278/stat : 10278 (TNM) R 10276 10278 10278 0 -1 4202496 554 0 0 0 1 0 0 0 21 0 1 0 548446147 462151680 264 33554432000 134512640 135008748 4292428464 18446744073709551615 134580187 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10278/statm: 112830 264 45 122 0 111730 0
[pid=10099/tid=10106] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10106/stat : 10106 (python) S 10097 10099 9896 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 36 0 548308158 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 2 0 0 0
[pid=10099/tid=10109] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10109/stat : 10109 (python) S 10097 10099 9896 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 36 0 548308162 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 3 0 0 0
[pid=10099/tid=10112] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10112/stat : 10112 (python) S 10097 10099 9896 0 -1 4202560 107 932 0 0 0 0 0 0 18 0 36 0 548308166 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 0 0 0 0
[pid=10099/tid=10115] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10115/stat : 10115 (python) S 10097 10099 9896 0 -1 4202560 45 932 0 0 0 0 0 0 15 0 36 0 548308169 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10118] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10118/stat : 10118 (python) S 10097 10099 9896 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 36 0 548308173 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 0 0 0 0
[pid=10099/tid=10121] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10121/stat : 10121 (python) S 10097 10099 9896 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 36 0 548308177 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 7 0 0 0
[pid=10099/tid=10124] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10124/stat : 10124 (python) S 10097 10099 9896 0 -1 4202560 41 932 0 0 0 0 0 0 18 0 36 0 548308181 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10127] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10127/stat : 10127 (python) S 10097 10099 9896 0 -1 4202560 44 932 0 0 0 0 0 0 18 0 36 0 548308185 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10134] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10134/stat : 10134 (python) S 10097 10099 9896 0 -1 4202560 51 932 0 0 0 0 0 0 18 0 36 0 548318211 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10149] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10149/stat : 10149 (python) S 10097 10099 9896 0 -1 4202560 63 932 0 0 0 0 0 0 15 0 36 0 548337420 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 5 0 0 0
[pid=10099/tid=10152] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10152/stat : 10152 (python) S 10097 10099 9896 0 -1 4202560 58 932 0 0 0 0 0 0 18 0 36 0 548337427 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10155] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10155/stat : 10155 (python) S 10097 10099 9896 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 36 0 548337438 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10158] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10158/stat : 10158 (python) S 10097 10099 9896 0 -1 4202560 32 932 0 0 0 0 0 0 19 0 36 0 548337723 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10164] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10164/stat : 10164 (python) S 10097 10099 9896 0 -1 4202560 45 932 0 0 0 0 0 0 19 0 36 0 548347255 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10167] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10167/stat : 10167 (python) S 10097 10099 9896 0 -1 4202560 54 932 0 0 0 0 0 0 18 0 36 0 548347344 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10171] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10171/stat : 10171 (python) S 10097 10099 9896 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 36 0 548347753 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10174] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10174/stat : 10174 (python) S 10097 10099 9896 0 -1 4202560 36 932 0 0 0 0 0 0 19 0 36 0 548348071 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 4 0 0 0
[pid=10099/tid=10184] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10184/stat : 10184 (python) S 10097 10099 9896 0 -1 4202560 40 932 0 0 0 0 0 0 20 0 36 0 548357199 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10189] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10189/stat : 10189 (python) S 10097 10099 9896 0 -1 4202560 42 932 0 0 0 0 0 0 20 0 36 0 548366607 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10194] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10194/stat : 10194 (python) S 10097 10099 9896 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 36 0 548367229 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10198] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10198/stat : 10198 (python) S 10097 10099 9896 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 36 0 548367405 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10203] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10203/stat : 10203 (python) S 10097 10099 9896 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 36 0 548367813 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10209] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10209/stat : 10209 (python) S 10097 10099 9896 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 36 0 548376541 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10215] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10215/stat : 10215 (python) S 10097 10099 9896 0 -1 4202560 53 932 0 0 0 0 0 0 18 0 36 0 548377845 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10221] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10221/stat : 10221 (python) S 10097 10099 9896 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 36 0 548386856 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10224] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10224/stat : 10224 (python) S 10097 10099 9896 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 36 0 548387075 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10232] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10232/stat : 10232 (python) S 10097 10099 9896 0 -1 4202560 37 932 0 0 0 0 0 0 19 0 36 0 548397411 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10237] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10237/stat : 10237 (python) S 10097 10099 9896 0 -1 4202560 36 932 0 0 0 0 0 0 20 0 36 0 548405417 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10245] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10245/stat : 10245 (python) S 10097 10099 9896 0 -1 4202560 40 932 0 0 0 0 0 0 20 0 36 0 548416136 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10250] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10250/stat : 10250 (python) S 10097 10099 9896 0 -1 4202560 33 932 0 0 0 0 0 0 19 0 36 0 548416968 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 3 0 0 0
[pid=10099/tid=10256] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10256/stat : 10256 (python) S 10097 10099 9896 0 -1 4202560 35 932 0 0 0 0 0 0 19 0 36 0 548426072 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10261] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10261/stat : 10261 (python) S 10097 10099 9896 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 36 0 548427010 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10267] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10267/stat : 10267 (python) S 10097 10099 9896 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 36 0 548436109 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
[pid=10099/tid=10273] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10273/stat : 10273 (python) S 10097 10099 9896 0 -1 4202560 39 932 0 0 0 0 0 0 20 0 36 0 548445537 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 1 0 0 0
[pid=10099/tid=10277] ppid=10097 vsize=730132 CPUtime=0 cores=0-7
/proc/10099/task/10277/stat : 10277 (python) S 10097 10099 9896 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 36 0 548446147 747655168 14669 33554432000 4194304 5683644 140736300074848 18446744073709551615 251826063793 0 0 16781312 2 18446604444223421248 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10997.3
Current children cumulated vsize (KiB) 32915324

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10099 and gives
#  childrusage.ru_utime.tv_sec=3051
#  childrusage.ru_utime.tv_usec=566091
#  childrusage.ru_stime.tv_sec=12
#  childrusage.ru_stime.tv_usec=881041
# CPU time returned by wait4() is 3064.45
# while last known CPU time is 10997.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1386.51
CPU time (s): 10997.3
CPU user time (s): 10983.3
CPU system time (s): 13.99
CPU usage (%): 793.168
Max. virtual memory (cumulated for all children) (KiB): 32915324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3051.57
system time used= 12.881
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 141455
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16151
involuntary context switches= 16952

runsolver used 12.7701 second user time and 32.746 second system time

The end

Launcher Data 

Begin job on node126 at 2011-05-02 22:11:28
IDJOB=3321778
IDBENCH=82556
IDSOLVER=1712
FILE ID=node126/3321778-1304367088
RUNJOBID= node126-1304366466-9910
PBS_JOBID= 13181745
Free space on /tmp= 73636 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v30000-c126000-S1196935200-064-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321778-1304367088/watcher-3321778-1304367088 -o /tmp/evaluation-result-3321778-1304367088/solver-3321778-1304367088 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321778-1304367088.cnf -seed 358744891 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a5ac359cd8af4f1e83d886effb49a2a9
RANDOM SEED=358744891

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       8314052 kB
Buffers:        346168 kB
Cached:        2024044 kB
SwapCached:         76 kB
Active:       22378092 kB
Inactive:      1869204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       8314052 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:           34160 kB
Writeback:           0 kB
AnonPages:    21877548 kB
Mapped:          24976 kB
Slab:           263580 kB
PageTables:      58620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 45927500 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73604 MiB
End job on node126 at 2011-05-02 22:34:37