Trace number 3321803

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9517.54 1196.91

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S317257086-003-UNKNOWN.cnf
MD5SUM6f9c7c042784ec486e9e8bc570309805
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.36/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.68	c INFO: solving HOME/instance-3321803-1304367627.cnf
0.36/0.68	c INFO: computing task features
0.53/0.82	c INFO: computed variable-clause graph statistics
0.53/0.83	c INFO: computed clause balance statistics
1.23/1.57	c INFO: computed variable balance statistics
1.53/1.87	c INFO: computed small-clause counts
1.53/1.87	c INFO: computed Horn-clause counts
1.53/1.89	c INFO: computed variable graph statistics
1.53/1.89	c INFO: collected features for HOME/instance-3321803-1304367627.cnf in 1.21 s
1.63/1.93	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.36)
1.63/1.97	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.73/2.00	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
1.73/2.04	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
1.73/2.08	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.29/2.12	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.29/2.16	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.29/2.20	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
795.33/101.50	c INFO: running adaptg2wsat2009++@0 for 97 with 39899 remaining (b = 0.02)
801.77/102.22	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
801.77/102.26	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.32/102.32	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.32/102.37	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.68/102.43	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.98/102.50	c INFO: running TNM@0 for 1552 with 39898 remaining (b = 0.20)
802.98/102.56	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.01)
1595.19/201.77	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1600.83/202.50	c INFO: running hybridGM3@0 for 194 with 39798 remaining (b = 0.02)
1602.22/202.65	c INFO: running adaptg2wsat2009++@0 for 97 with 39798 remaining (b = 0.01)
1643.81/207.90	c INFO: running adaptg2wsat2009++@0 for 97 with 39792 remaining (b = 0.01)
2354.84/297.09	c INFO: running hybridGM3@100 for 97 with 39703 remaining (b = 0.01)
2369.07/298.80	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2369.87/298.93	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2377.81/299.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39700 remaining (b = 0.01)
2394.57/302.10	c INFO: running adaptg2wsat2009++@97 for 97 with 39698 remaining (b = 0.01)
2419.25/305.18	c INFO: running hybridGM3@0 for 194 with 39695 remaining (b = 0.02)
3146.99/396.44	c INFO: running hybridGM3@295 for 97 with 39604 remaining (b = 0.01)
3151.83/397.10	c INFO: running hybridGM3@100 for 97 with 39603 remaining (b = 0.01)
3153.32/397.23	c INFO: running TNM@0 for 1552 with 39603 remaining (b = 0.15)
3170.84/399.40	c INFO: running adaptg2wsat2009++@100 for 97 with 39601 remaining (b = 0.01)
3175.60/400.09	c INFO: running hybridGM3@295 for 97 with 39600 remaining (b = 0.01)
3177.21/400.22	c INFO: running iPAWS@0 for 97 with 39600 remaining (b = 0.01)
3935.21/495.38	c INFO: running hybridGM3@396 for 97 with 39505 remaining (b = 0.01)
3945.58/496.70	c INFO: running FH@0 for 291 with 39504 remaining (b = 0.03)
3951.95/497.43	c INFO: running gnovelty+2@0 for 97 with 39503 remaining (b = 0.01)
3954.06/497.75	c INFO: running hybridGM3@0 for 194 with 39503 remaining (b = 0.02)
4008.46/504.56	c INFO: running adaptg2wsat2009++@100 for 97 with 39496 remaining (b = 0.01)
4033.95/507.79	c INFO: running hybridGM3@98 for 97 with 39492 remaining (b = 0.01)
4694.65/590.68	c INFO: running FH@100 for 291 with 39410 remaining (b = 0.02)
4783.78/601.87	c INFO: running adaptg2wsat2009++@298 for 291 with 39398 remaining (b = 0.02)
4785.36/602.10	c INFO: running hybridGM3@0 for 194 with 39398 remaining (b = 0.02)
4791.78/602.82	c INFO: running TNM@0 for 1552 with 39397 remaining (b = 0.12)
5559.91/699.40	c INFO: running hybridGM3@100 for 97 with 39301 remaining (b = 0.01)
6285.15/790.48	c INFO: running iPAWS@0 for 97 with 39210 remaining (b = 0.01)
6343.23/797.72	c INFO: running hybridGM3@102 for 97 with 39203 remaining (b = 0.01)
6367.21/800.71	c INFO: running hybridGM3@393 for 97 with 39200 remaining (b = 0.01)
7001.61/880.42	c INFO: running FH@197 for 194 with 39120 remaining (b = 0.02)
7074.00/889.58	c INFO: running adaptg2wsat2009++@392 for 194 with 39111 remaining (b = 0.02)
7125.74/896.01	c INFO: running FH@0 for 97 with 39104 remaining (b = 0.01)
7132.09/896.82	c INFO: running iPAWS@0 for 97 with 39103 remaining (b = 0.01)
7149.57/899.04	c INFO: running hybridGM3@0 for 194 with 39101 remaining (b = 0.01)
7924.05/996.38	c INFO: running NCVWr@0 for 485 with 39004 remaining (b = 0.03)
7930.41/997.17	c INFO: running adaptg2wsat2009++@102 for 97 with 39003 remaining (b = 0.01)
8573.60/1077.98	c INFO: running gnovelty+2@0 for 97 with 38922 remaining (b = 0.01)
8638.77/1086.16	c INFO: running adaptg2wsat2009++@487 for 97 with 38914 remaining (b = 0.01)
8705.70/1094.52	c INFO: running hybridGM3@0 for 194 with 38906 remaining (b = 0.01)
8707.02/1094.73	c INFO: running hybridGM3@100 for 97 with 38906 remaining (b = 0.01)
9395.82/1181.50	c INFO: running adaptg2wsat2009++@298 for 291 with 38819 remaining (b = 0.02)
9418.78/1184.39	c INFO: running FH@99 for 291 with 38816 remaining (b = 0.02)
9511.79/1196.08	c INFO: running iPAWS@0 for 97 with 38804 remaining (b = 0.01)
9517.54/1196.86	c INFO: running hybridGM3@0 for 194 with 38803 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321803-1304367627/watcher-3321803-1304367627 -o /tmp/evaluation-result-3321803-1304367627/solver-3321803-1304367627 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321803-1304367627.cnf -seed 1968896656 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.07 7.74 7.18 2/281 19025
/proc/meminfo: memFree=23613184/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=15764 CPUtime=0 cores=0-7
/proc/19025/stat : 19025 (python) S 19023 19025 18999 0 -1 4202496 845 0 0 0 0 0 0 0 17 0 1 0 626993387 16142336 728 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415389696 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/19025/statm: 3941 728 334 364 0 428 0

[startup+0.0173601 s]
/proc/loadavg: 7.07 7.74 7.18 2/281 19025
/proc/meminfo: memFree=23613184/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=16240 CPUtime=0 cores=0-7
/proc/19025/stat : 19025 (python) R 19023 19025 18999 0 -1 4202496 997 0 0 0 0 0 0 0 17 0 1 0 626993387 16629760 870 33554432000 4194304 5683644 140735179420544 18446744073709551615 4429309 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19025/statm: 4060 870 368 364 0 547 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16240

[startup+0.100335 s]
/proc/loadavg: 7.07 7.74 7.18 2/281 19025
/proc/meminfo: memFree=23613184/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=85620 CPUtime=0.06 cores=0-7
/proc/19025/stat : 19025 (python) S 19023 19025 18999 0 -1 4202496 2630 0 0 0 4 2 0 0 17 0 1 0 626993387 87674880 2348 33554432000 4194304 5683644 140735179420544 18446744073709551615 256410467975 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/19025/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.300311 s]
/proc/loadavg: 7.07 7.74 7.18 2/281 19025
/proc/meminfo: memFree=23613184/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=135748 CPUtime=0.2 cores=0-7
/proc/19025/stat : 19025 (python) S 19023 19025 18999 0 -1 4202496 5966 931 1 0 14 6 0 0 17 0 1 0 626993387 139005952 4151 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415387653 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/19025/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 135748

[startup+0.700244 s]
/proc/loadavg: 7.07 7.74 7.18 2/281 19025
/proc/meminfo: memFree=23613184/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=279136 CPUtime=0.43 cores=0-7
/proc/19025/stat : 19025 (python) R 19023 19025 18999 0 -1 4202496 9445 931 1 0 31 12 0 0 16 0 1 0 626993387 285835264 7123 33554432000 4194304 5683644 140735179420544 18446744073709551615 4602391 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19025/statm: 69784 7123 1761 364 0 5708 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 279136

[startup+1.50107 s]
/proc/loadavg: 7.07 7.74 7.18 2/282 19030
/proc/meminfo: memFree=23585772/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=283912 CPUtime=1.23 cores=0-7
/proc/19025/stat : 19025 (python) R 19023 19025 18999 0 -1 4202496 11846 931 1 0 111 12 0 0 17 0 1 0 626993387 290725888 8363 33554432000 4194304 5683644 140735179420544 18446744073709551615 46929951531237 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19025/statm: 70978 8363 1826 364 0 6902 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 283912

[startup+3.10068 s]
/proc/loadavg: 6.74 7.66 7.16 7/297 19045
/proc/meminfo: memFree=23558980/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=427180 CPUtime=1.93 cores=0-7
/proc/19025/stat : 19025 (python) S 19023 19025 18999 0 -1 4202496 17872 931 1 0 179 14 0 0 25 0 9 0 626993387 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19025/statm: 106795 7522 1891 364 0 42692 0
[pid=19031] ppid=19025 vsize=279924 CPUtime=0 cores=0-7
/proc/19031/stat : 19031 (python) S 19025 19025 18999 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 626993581 286642176 5769 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411727 0 0 16781312 514 4073735390303846657 0 0 17 1 0 0 0
/proc/19031/statm: 69981 5769 355 364 0 5899 0
[pid=19033] ppid=19031 vsize=1018820 CPUtime=1.15 cores=0-7
/proc/19033/stat : 19033 (gnovelty+2) R 19031 19033 19033 0 -1 4202496 858 0 0 0 115 0 0 0 22 0 1 0 626993581 1043271680 595 33554432000 134512640 135663704 4294135584 18446744073709551615 134525258 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19033/statm: 254705 595 113 282 0 254421 0
[pid=19034] ppid=19025 vsize=290820 CPUtime=0 cores=0-7
/proc/19034/stat : 19034 (python) S 19025 19025 18999 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 626993585 297799680 5792 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 1589462534623035652 0 0 17 1 0 0 0
/proc/19034/statm: 72705 5792 349 364 0 8620 0
[pid=19036] ppid=19034 vsize=1018820 CPUtime=1.12 cores=0-7
/proc/19036/stat : 19036 (gnovelty+2) R 19034 19036 19036 0 -1 4202496 855 0 0 0 112 0 0 0 25 0 1 0 626993585 1043271680 595 33554432000 134512640 135663704 4291140704 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/19036/statm: 254705 595 113 282 0 254421 0
[pid=19037] ppid=19025 vsize=366680 CPUtime=0 cores=0-7
/proc/19037/stat : 19037 (python) S 19025 19025 18999 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 626993588 375480320 5815 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 5156485238192340991 0 0 17 4 0 0 0
/proc/19037/statm: 91670 5815 349 364 0 27582 0
[pid=19039] ppid=19037 vsize=419160 CPUtime=1.08 cores=0-7
/proc/19039/stat : 19039 (adaptg2wsat2009) R 19037 19039 19039 0 -1 4202496 1254 0 0 0 108 0 0 0 24 0 1 0 626993589 429219840 990 33554432000 134512640 135107411 4293048000 18446744073709551615 134523312 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/19039/statm: 104790 990 49 146 0 103666 0
[pid=19040] ppid=19025 vsize=375912 CPUtime=0 cores=0-7
/proc/19040/stat : 19040 (python) S 19025 19025 18999 0 -1 4202560 713 0 0 0 0 0 0 0 18 0 1 0 626993592 384933888 5988 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 15419717648237199359 0 0 17 0 0 0 0
/proc/19040/statm: 93978 5988 348 364 0 29887 0
[pid=19042] ppid=19040 vsize=419160 CPUtime=1.04 cores=0-7
/proc/19042/stat : 19042 (adaptg2wsat2009) R 19040 19042 19042 0 -1 4202496 1243 0 0 0 104 0 0 0 25 0 1 0 626993593 429219840 992 33554432000 134512640 135107411 4290384432 18446744073709551615 134523426 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19042/statm: 104790 992 49 146 0 103666 0
[pid=19043] ppid=19025 vsize=386168 CPUtime=0 cores=0-7
/proc/19043/stat : 19043 (python) S 19025 19025 18999 0 -1 4202560 724 0 0 0 0 0 0 0 18 0 1 0 626993596 395436032 5963 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 12195418216603844607 0 0 17 1 0 0 0
/proc/19043/statm: 96542 5963 348 364 0 32448 0
[pid=19045] ppid=19043 vsize=419160 CPUtime=0.98 cores=0-7
/proc/19045/stat : 19045 (adaptg2wsat2009) R 19043 19045 19045 0 -1 4202496 1250 0 0 0 98 0 0 0 21 0 1 0 626993596 429219840 990 33554432000 134512640 135107411 4289300032 18446744073709551615 134523426 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/19045/statm: 104790 990 49 146 0 103666 0
[pid=19025/tid=19032] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19032/stat : 19032 (python) S 19023 19025 18999 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 9 0 626993581 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 2 0 0 0
[pid=19025/tid=19035] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19035/stat : 19035 (python) S 19023 19025 18999 0 -1 4202560 20 931 0 0 0 0 0 0 18 0 9 0 626993585 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19038] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19038/stat : 19038 (python) S 19023 19025 18999 0 -1 4202560 22 931 0 0 0 0 0 0 18 0 9 0 626993588 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 1 0 0 0
[pid=19025/tid=19041] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19041/stat : 19041 (python) S 19023 19025 18999 0 -1 4202560 93 931 0 0 0 0 0 0 22 0 9 0 626993592 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19044] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19044/stat : 19044 (python) S 19023 19025 18999 0 -1 4202560 32 931 0 0 0 0 0 0 23 0 9 0 626993596 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7.3
Current children cumulated vsize (KiB) 5421804

[startup+6.30108 s]
/proc/loadavg: 6.74 7.66 7.16 9/306 19054
/proc/meminfo: memFree=23533340/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=427180 CPUtime=1.93 cores=0-7
/proc/19025/stat : 19025 (python) S 19023 19025 18999 0 -1 4202496 17872 931 1 0 179 14 0 0 25 0 9 0 626993387 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19025/statm: 106795 7522 1891 364 0 42692 0
[pid=19031] ppid=19025 vsize=279924 CPUtime=0 cores=0-7
/proc/19031/stat : 19031 (python) S 19025 19025 18999 0 -1 4202560 880 0 0 0 0 0 0 0 18 0 1 0 626993581 286642176 5792 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411727 0 0 16781312 514 4073735390303846657 0 0 17 1 0 0 0
/proc/19031/statm: 69981 5792 378 364 0 5899 0
[pid=19033] ppid=19031 vsize=1018820 CPUtime=4.35 cores=0-7
/proc/19033/stat : 19033 (gnovelty+2) R 19031 19033 19033 0 -1 4202496 858 0 0 0 435 0 0 0 25 0 1 0 626993581 1043271680 595 33554432000 134512640 135663704 4294135584 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19033/statm: 254705 595 113 282 0 254421 0
[pid=19034] ppid=19025 vsize=290820 CPUtime=0 cores=0-7
/proc/19034/stat : 19034 (python) S 19025 19025 18999 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 626993585 297799680 5815 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 1589462534623035652 0 0 17 1 0 0 0
/proc/19034/statm: 72705 5815 372 364 0 8620 0
[pid=19036] ppid=19034 vsize=1018820 CPUtime=4.32 cores=0-7
/proc/19036/stat : 19036 (gnovelty+2) R 19034 19036 19036 0 -1 4202496 855 0 0 0 432 0 0 0 25 0 1 0 626993585 1043271680 595 33554432000 134512640 135663704 4291140704 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/19036/statm: 254705 595 113 282 0 254421 0
[pid=19037] ppid=19025 vsize=366680 CPUtime=0.01 cores=0-7
/proc/19037/stat : 19037 (python) S 19025 19025 18999 0 -1 4202560 920 0 0 0 0 1 0 0 18 0 1 0 626993588 375480320 5838 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 5156485238192308484 0 0 17 4 0 0 0
/proc/19037/statm: 91670 5838 372 364 0 27582 0
[pid=19039] ppid=19037 vsize=419428 CPUtime=4.28 cores=0-7
/proc/19039/stat : 19039 (adaptg2wsat2009) R 19037 19039 19039 0 -1 4202496 1440 0 0 0 428 0 0 0 25 0 1 0 626993589 429494272 1176 33554432000 134512640 135107411 4293048000 18446744073709551615 134532376 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/19039/statm: 104857 1176 59 146 0 103733 0
[pid=19040] ppid=19025 vsize=375912 CPUtime=0 cores=0-7
/proc/19040/stat : 19040 (python) S 19025 19025 18999 0 -1 4202560 787 0 0 0 0 0 0 0 18 0 1 0 626993592 384933888 6011 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 15419717648237166851 0 0 17 0 0 0 0
/proc/19040/statm: 93978 6011 371 364 0 29887 0
[pid=19042] ppid=19040 vsize=419428 CPUtime=4.23 cores=0-7
/proc/19042/stat : 19042 (adaptg2wsat2009) R 19040 19042 19042 0 -1 4202496 1428 0 0 0 423 0 0 0 25 0 1 0 626993593 429494272 1177 33554432000 134512640 135107411 4290384432 18446744073709551615 134531696 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19042/statm: 104857 1177 59 146 0 103733 0
[pid=19043] ppid=19025 vsize=386168 CPUtime=0 cores=0-7
/proc/19043/stat : 19043 (python) S 19025 19025 18999 0 -1 4202560 802 0 0 0 0 0 0 0 18 0 1 0 626993596 395436032 5986 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 12195418216603812097 0 0 17 1 0 0 0
/proc/19043/statm: 96542 5986 371 364 0 32448 0
[pid=19045] ppid=19043 vsize=419428 CPUtime=4.14 cores=0-7
/proc/19045/stat : 19045 (adaptg2wsat2009) R 19043 19045 19045 0 -1 4202496 1436 0 0 0 414 0 0 0 25 0 1 0 626993596 429494272 1176 33554432000 134512640 135107411 4289300032 18446744073709551615 134531246 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/19045/statm: 104857 1176 59 146 0 103733 0
[pid=19046] ppid=19025 vsize=396424 CPUtime=0.01 cores=0-7
/proc/19046/stat : 19046 (python) S 19025 19025 18999 0 -1 4202560 811 0 0 0 0 1 0 0 18 0 1 0 626993600 405938176 5956 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 4112069588328349955 0 0 17 6 0 0 0
/proc/19046/statm: 99106 5956 371 364 0 35009 0
[pid=19048] ppid=19046 vsize=1018820 CPUtime=4.15 cores=0-7
/proc/19048/stat : 19048 (gnovelty+2) R 19046 19048 19048 0 -1 4202496 852 0 0 0 415 0 0 0 25 0 1 0 626993600 1043271680 595 33554432000 134512640 135663704 4292513840 18446744073709551615 134525497 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19048/statm: 254705 595 113 282 0 254421 0
[pid=19049] ppid=19025 vsize=406680 CPUtime=0 cores=0-7
/proc/19049/stat : 19049 (python) S 19025 19025 18999 0 -1 4202560 820 0 0 0 0 0 0 0 18 0 1 0 626993604 416440320 6087 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 13921260595828457732 0 0 17 7 0 0 0
/proc/19049/statm: 101670 6087 370 364 0 37570 0
[pid=19051] ppid=19049 vsize=249196 CPUtime=4.06 cores=0-7
/proc/19051/stat : 19051 (FH) R 19049 19051 19051 0 -1 4202496 1317 0 0 0 406 0 0 0 25 0 1 0 626993606 255176704 1058 33554432000 134512640 134936988 4293531984 18446744073709551615 134552481 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/19051/statm: 62299 1058 41 104 0 61803 0
[pid=19052] ppid=19025 vsize=416936 CPUtime=0 cores=0-7
/proc/19052/stat : 19052 (python) S 19025 19025 18999 0 -1 4202560 849 0 0 0 0 0 0 0 18 0 1 0 626993607 426942464 6004 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 13921264444119154946 0 0 17 6 0 0 0
/proc/19052/statm: 104234 6004 377 364 0 40131 0
[pid=19054] ppid=19052 vsize=419428 CPUtime=4.05 cores=0-7
/proc/19054/stat : 19054 (adaptg2wsat2009) R 19052 19054 19054 0 -1 4202496 1439 0 0 0 405 0 0 0 25 0 1 0 626993608 429494272 1175 33554432000 134512640 135107411 4293909392 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19054/statm: 104857 1175 59 146 0 103733 0
[pid=19025/tid=19032] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19032/stat : 19032 (python) S 19023 19025 18999 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 9 0 626993581 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 2 0 0 0
[pid=19025/tid=19035] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19035/stat : 19035 (python) S 19023 19025 18999 0 -1 4202560 20 931 0 0 0 0 0 0 18 0 9 0 626993585 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19038] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19038/stat : 19038 (python) S 19023 19025 18999 0 -1 4202560 22 931 0 0 0 0 0 0 18 0 9 0 626993588 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 1 0 0 0
[pid=19025/tid=19041] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19041/stat : 19041 (python) S 19023 19025 18999 0 -1 4202560 93 931 0 0 0 0 0 0 22 0 9 0 626993592 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19044] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19044/stat : 19044 (python) S 19023 19025 18999 0 -1 4202560 32 931 0 0 0 0 0 0 23 0 9 0 626993596 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19047] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19047/stat : 19047 (python) S 19023 19025 18999 0 -1 4202560 32 931 0 0 0 0 0 0 25 0 9 0 626993600 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19050] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19050/stat : 19050 (python) S 19023 19025 18999 0 -1 4202560 34 931 0 0 0 0 0 0 25 0 9 0 626993604 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 6 0 0 0
[pid=19025/tid=19053] ppid=19023 vsize=427180 CPUtime=0 cores=0-7
/proc/19025/task/19053/stat : 19053 (python) S 19023 19025 18999 0 -1 4202560 86 931 0 0 0 0 0 0 25 0 9 0 626993608 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 35.53
Current children cumulated vsize (KiB) 8330092

[startup+12.7019 s]
/proc/loadavg: 6.93 7.67 7.17 9/306 19054
/proc/meminfo: memFree=23531296/32950928 swapFree=67111364/67111528
[pid=19025] ppid=19023 vsize=427180 CPUtime=1.93 cores=0-7
/proc/19025/stat : 19025 (python) S 19023 19025 18999 0 -1 4202496 17872 931 1 0 179 14 0 0 25 0 9 0 626993387 437432320 7522 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0

################
# More data... #
################

[pid=19124] ppid=19025 vsize=560520 CPUtime=0.25 cores=0-7
/proc/19124/stat : 19124 (python) S 19025 19025 18999 0 -1 4202560 1177 0 0 0 13 12 0 0 19 0 2 0 627043131 573972480 6379 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/19124/statm: 140130 6379 407 364 0 75985 0
[pid=19126] ppid=19124 vsize=1018820 CPUtime=102 cores=0-7
/proc/19126/stat : 19126 (gnovelty+2) T 19124 19126 19126 0 -1 4202496 878 0 0 0 10200 0 0 0 25 0 1 0 627043131 1043271680 595 33554432000 134512640 135663704 4288363488 18446744073709551615 134545631 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/19126/statm: 254705 595 113 282 0 254421 0
[pid=19124/tid=19138] ppid=19025 vsize=560520 CPUtime=0 cores=0-7
/proc/19124/task/19138/stat : 19138 (python) S 19025 19025 18999 0 -1 4202560 81 0 0 0 0 0 0 0 19 0 2 0 627053660 573972480 6379 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604471132419136 0 0 -1 6 0 0 0
[pid=19127] ppid=19025 vsize=570776 CPUtime=0.93 cores=0-7
/proc/19127/stat : 19127 (python) S 19025 19025 18999 0 -1 4202560 1193 0 0 0 47 46 0 0 18 0 2 0 627043163 584474624 6460 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/19127/statm: 142694 6460 407 364 0 78546 0
[pid=19129] ppid=19127 vsize=268424 CPUtime=391.28 cores=0-7
/proc/19129/stat : 19129 (hybridGM3) T 19127 19129 19129 0 -1 4202496 5292 0 0 0 39128 0 0 0 25 0 1 0 627043163 274866176 5010 33554432000 134512640 135204385 4294071184 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/19129/statm: 67106 5010 63 169 0 66936 0
[pid=19127/tid=19145] ppid=19025 vsize=570776 CPUtime=0 cores=0-7
/proc/19127/task/19145/stat : 19145 (python) S 19025 19025 18999 0 -1 4202560 85 0 0 0 0 0 0 0 18 0 2 0 627063319 584474624 6460 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604465221669120 0 0 -1 3 0 0 0
[pid=19135] ppid=19025 vsize=581032 CPUtime=0.69 cores=0-7
/proc/19135/stat : 19135 (python) S 19025 19025 18999 0 -1 4202560 1217 0 0 0 36 33 0 0 18 0 2 0 627053598 594976768 6436 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/19135/statm: 145258 6436 406 364 0 81107 0
[pid=19137] ppid=19135 vsize=268424 CPUtime=295.92 cores=0-7
/proc/19137/stat : 19137 (hybridGM3) T 19135 19137 19137 0 -1 4202496 5294 0 0 0 29592 0 0 0 25 0 1 0 627053598 274866176 5010 33554432000 134512640 135204385 4291274016 18446744073709551615 134537704 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/19137/statm: 67106 5010 63 169 0 66936 0
[pid=19135/tid=19151] ppid=19025 vsize=581032 CPUtime=0 cores=0-7
/proc/19135/task/19151/stat : 19151 (python) S 19025 19025 18999 0 -1 4202560 91 0 0 0 0 0 0 0 18 0 2 0 627073150 594976768 6436 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604470842033280 0 0 -1 6 0 0 0
[pid=19139] ppid=19025 vsize=591288 CPUtime=1.43 cores=0-7
/proc/19139/stat : 19139 (python) S 19025 19025 18999 0 -1 4202560 986 0 0 0 74 69 0 0 18 0 1 0 627053669 605478912 6486 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 13262098148001546501 0 0 17 3 0 0 0
/proc/19139/statm: 147822 6486 372 364 0 83668 0
[pid=19141] ppid=19139 vsize=457664 CPUtime=578.65 cores=0-7
/proc/19141/stat : 19141 (TNM) R 19139 19141 19141 0 -1 4202496 1320 0 0 0 57865 0 0 0 25 0 1 0 627053670 468647936 1037 33554432000 134512640 135008748 4292112672 18446744073709551615 134527804 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/19141/statm: 114416 1037 46 122 0 113316 0
[pid=19148] ppid=19025 vsize=601544 CPUtime=0.25 cores=0-7
/proc/19148/stat : 19148 (python) S 19025 19025 18999 0 -1 4202560 1190 0 0 0 13 12 0 0 19 0 2 0 627072435 615981056 6427 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/19148/statm: 150386 6427 400 364 0 86229 0
[pid=19150] ppid=19148 vsize=335996 CPUtime=102.44 cores=0-7
/proc/19150/stat : 19150 (iPAWS) T 19148 19150 19150 0 -1 4202496 1709 0 0 0 10244 0 0 0 25 0 1 0 627072436 344059904 1428 33554432000 134512640 135114423 4289703408 18446744073709551615 134554741 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/19150/statm: 83999 1428 59 147 0 83851 0
[pid=19148/tid=19158] ppid=19025 vsize=601544 CPUtime=0 cores=0-7
/proc/19148/task/19158/stat : 19158 (python) S 19025 19025 18999 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 627083060 615981056 6427 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604471150577600 0 0 -1 2 0 0 0
[pid=19155] ppid=19025 vsize=611800 CPUtime=0.25 cores=0-7
/proc/19155/stat : 19155 (python) S 19025 19025 18999 0 -1 4202560 1197 0 0 0 13 12 0 0 19 0 2 0 627082989 626483200 6485 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/19155/statm: 152950 6485 400 364 0 88790 0
[pid=19157] ppid=19155 vsize=249196 CPUtime=100.25 cores=0-7
/proc/19157/stat : 19157 (FH) T 19155 19157 19157 0 -1 4202496 1340 0 0 0 10025 0 0 0 25 0 1 0 627082990 255176704 1059 33554432000 134512640 134936988 4290140064 18446744073709551615 134545109 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/19157/statm: 62299 1059 41 104 0 61803 0
[pid=19155/tid=19168] ppid=19025 vsize=611800 CPUtime=0 cores=0-7
/proc/19155/task/19168/stat : 19168 (python) S 19025 19025 18999 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 627093015 626483200 6485 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604460726366336 0 0 -1 4 0 0 0
[pid=19159] ppid=19025 vsize=622056 CPUtime=0.25 cores=0-7
/proc/19159/stat : 19159 (python) S 19025 19025 18999 0 -1 4202560 1203 0 0 0 14 11 0 0 19 0 2 0 627083070 636985344 6492 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/19159/statm: 155514 6492 401 364 0 91351 0
[pid=19161] ppid=19159 vsize=335996 CPUtime=100.23 cores=0-7
/proc/19161/stat : 19161 (iPAWS) T 19159 19161 19161 0 -1 4202496 1711 0 0 0 10023 0 0 0 25 0 1 0 627083071 344059904 1429 33554432000 134512640 135114423 4294106064 18446744073709551615 134515637 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/19161/statm: 83999 1429 59 147 0 83851 0
[pid=19159/tid=19172] ppid=19025 vsize=622056 CPUtime=0 cores=0-7
/proc/19159/task/19172/stat : 19172 (python) S 19025 19025 18999 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 627093095 636985344 6492 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604460726367232 0 0 -1 0 0 0 0
[pid=19162] ppid=19025 vsize=632312 CPUtime=0.74 cores=0-7
/proc/19162/stat : 19162 (python) S 19025 19025 18999 0 -1 4202560 1243 0 0 0 40 34 0 0 18 0 2 0 627083291 647487488 6558 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/19162/statm: 158078 6558 406 364 0 93912 0
[pid=19164] ppid=19162 vsize=268428 CPUtime=296.05 cores=0-7
/proc/19164/stat : 19164 (hybridGM3) T 19162 19164 19164 0 -1 4202496 5302 0 0 0 29605 0 0 0 25 0 1 0 627083292 274870272 5010 33554432000 134512640 135204385 4292007312 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/19164/statm: 67107 5010 63 169 0 66937 0
[pid=19162/tid=19181] ppid=19025 vsize=632312 CPUtime=0 cores=0-7
/proc/19162/task/19181/stat : 19181 (python) S 19025 19025 18999 0 -1 4202560 87 0 0 0 0 0 0 0 18 0 2 0 627102850 647487488 6558 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604468107622336 0 0 -1 2 0 0 0
[pid=19169] ppid=19025 vsize=642568 CPUtime=0.49 cores=0-7
/proc/19169/stat : 19169 (python) S 19025 19025 18999 0 -1 4202560 1041 0 0 0 28 21 0 0 18 0 1 0 627093026 657989632 6487 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 13262098148001546502 0 0 17 0 0 0 0
/proc/19169/statm: 160642 6487 379 364 0 96473 0
[pid=19171] ppid=19169 vsize=419072 CPUtime=198.94 cores=0-7
/proc/19171/stat : 19171 (NCVWr) R 19169 19171 19171 0 -1 4202496 1361 0 0 0 19893 1 0 0 25 0 1 0 627093026 429129728 1078 33554432000 134512640 135113558 4286668800 18446744073709551615 134531944 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19171/statm: 104768 1078 58 147 0 103643 0
[pid=19175] ppid=19025 vsize=652824 CPUtime=0.26 cores=0-7
/proc/19175/stat : 19175 (python) S 19025 19025 18999 0 -1 4202560 1260 0 0 0 14 12 0 0 19 0 2 0 627101186 668491776 6463 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/19175/statm: 163206 6463 407 364 0 99034 0
[pid=19177] ppid=19175 vsize=1018820 CPUtime=101.51 cores=0-7
/proc/19177/stat : 19177 (gnovelty+2) T 19175 19177 19177 0 -1 4202496 885 0 0 0 10151 0 0 0 25 0 1 0 627101187 1043271680 596 33554432000 134512640 135663704 4288517696 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/19177/statm: 254705 596 113 282 0 254421 0
[pid=19175/tid=19188] ppid=19025 vsize=652824 CPUtime=0 cores=0-7
/proc/19175/task/19188/stat : 19188 (python) S 19025 19025 18999 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 627111816 668491776 6463 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 514 18446604468107621440 0 0 -1 7 0 0 0
[pid=19178] ppid=19025 vsize=663080 CPUtime=0.25 cores=0-7
/proc/19178/stat : 19178 (python) S 19025 19025 18999 0 -1 4202560 1074 0 0 0 13 12 0 0 18 0 1 0 627102840 678993920 6439 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 13262098148001546503 0 0 17 3 0 0 0
/proc/19178/statm: 165770 6439 378 364 0 101595 0
[pid=19180] ppid=19178 vsize=268420 CPUtime=101.77 cores=0-7
/proc/19180/stat : 19180 (hybridGM3) R 19178 19180 19180 0 -1 4202496 5296 0 0 0 10174 3 0 0 25 0 1 0 627102840 274862080 5008 33554432000 134512640 135204385 4288056304 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19180/statm: 67105 5008 63 169 0 66935 0
[pid=19189] ppid=19025 vsize=673336 CPUtime=0 cores=0-7
/proc/19189/stat : 19189 (python) S 19025 19025 18999 0 -1 4202560 919 0 0 0 0 0 0 0 19 0 1 0 627112996 689496064 6445 33554432000 4194304 5683644 140735179420544 18446744073709551615 256415411782 0 0 16781312 514 8083104266111156223 0 0 17 3 0 0 0
/proc/19189/statm: 168334 6445 346 364 0 104156 0
[pid=19191] ppid=19189 vsize=335996 CPUtime=0.63 cores=0-7
/proc/19191/stat : 19191 (iPAWS) R 19189 19191 19191 0 -1 4202496 1717 0 0 0 63 0 0 0 22 0 1 0 627112996 344059904 1428 33554432000 134512640 135114423 4289458736 18446744073709551615 134518715 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/19191/statm: 83999 1428 59 147 0 83851 0
[pid=19025/tid=19032] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19032/stat : 19032 (python) S 19023 19025 18999 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 34 0 626993581 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 2 0 0 0
[pid=19025/tid=19035] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19035/stat : 19035 (python) S 19023 19025 18999 0 -1 4202560 20 931 0 0 0 0 0 0 18 0 34 0 626993585 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19038] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19038/stat : 19038 (python) S 19023 19025 18999 0 -1 4202560 42 931 0 0 0 0 0 0 18 0 34 0 626993588 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 1 0 0 0
[pid=19025/tid=19041] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19041/stat : 19041 (python) S 19023 19025 18999 0 -1 4202560 99 931 0 0 0 0 0 0 18 0 34 0 626993592 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19044] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19044/stat : 19044 (python) S 19023 19025 18999 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 34 0 626993596 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19047] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19047/stat : 19047 (python) S 19023 19025 18999 0 -1 4202560 32 931 0 0 0 0 0 0 25 0 34 0 626993600 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19050] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19050/stat : 19050 (python) S 19023 19025 18999 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 626993604 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 6 0 0 0
[pid=19025/tid=19053] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19053/stat : 19053 (python) S 19023 19025 18999 0 -1 4202560 91 931 0 0 0 0 0 0 18 0 34 0 626993608 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 6 0 0 0
[pid=19025/tid=19060] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19060/stat : 19060 (python) S 19023 19025 18999 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 627003538 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 1 0 0 0
[pid=19025/tid=19066] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19066/stat : 19066 (python) S 19023 19025 18999 0 -1 4202560 43 931 0 0 0 0 0 0 18 0 34 0 627003610 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 6 0 0 0
[pid=19025/tid=19070] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19070/stat : 19070 (python) S 19023 19025 18999 0 -1 4202560 51 931 0 0 0 0 0 0 18 0 34 0 627003614 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 4 0 0 0
[pid=19025/tid=19074] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19074/stat : 19074 (python) S 19023 19025 18999 0 -1 4202560 33 931 0 0 0 0 0 0 22 0 34 0 627003620 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 1 0 0 0
[pid=19025/tid=19077] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19077/stat : 19077 (python) S 19023 19025 18999 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 627003625 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 1 0 0 0
[pid=19025/tid=19080] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19080/stat : 19080 (python) S 19023 19025 18999 0 -1 4202560 50 931 0 0 0 0 0 0 18 0 34 0 627003631 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 7 0 0 0
[pid=19025/tid=19085] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19085/stat : 19085 (python) S 19023 19025 18999 0 -1 4202560 34 931 0 0 0 0 0 0 21 0 34 0 627003638 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19088] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19088/stat : 19088 (python) S 19023 19025 18999 0 -1 4202560 53 931 0 0 0 0 0 0 18 0 34 0 627003644 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 7 0 0 0
[pid=19025/tid=19095] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19095/stat : 19095 (python) S 19023 19025 18999 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 627013565 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 7 0 0 0
[pid=19025/tid=19099] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19099/stat : 19099 (python) S 19023 19025 18999 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 34 0 627013638 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 7 0 0 0
[pid=19025/tid=19110] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19110/stat : 19110 (python) S 19023 19025 18999 0 -1 4202560 51 931 0 0 0 0 0 0 18 0 34 0 627023906 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19117] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19117/stat : 19117 (python) S 19023 19025 18999 0 -1 4202560 41 931 0 0 0 0 0 0 20 0 34 0 627033111 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19120] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19120/stat : 19120 (python) S 19023 19025 18999 0 -1 4202560 40 931 0 0 0 0 0 0 20 0 34 0 627033411 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 7 0 0 0
[pid=19025/tid=19125] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19125/stat : 19125 (python) S 19023 19025 18999 0 -1 4202560 34 931 0 0 0 0 0 0 20 0 34 0 627043131 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19128] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19128/stat : 19128 (python) S 19023 19025 18999 0 -1 4202560 44 931 0 0 0 0 0 0 18 0 34 0 627043163 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19136] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19136/stat : 19136 (python) S 19023 19025 18999 0 -1 4202560 44 931 0 0 0 0 0 0 18 0 34 0 627053598 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19140] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19140/stat : 19140 (python) S 19023 19025 18999 0 -1 4202560 34 931 0 0 0 0 0 0 20 0 34 0 627053670 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19149] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19149/stat : 19149 (python) S 19023 19025 18999 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 34 0 627072436 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19156] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19156/stat : 19156 (python) S 19023 19025 18999 0 -1 4202560 39 931 0 0 0 0 0 0 18 0 34 0 627082989 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19160] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19160/stat : 19160 (python) S 19023 19025 18999 0 -1 4202560 34 931 0 0 0 0 0 0 20 0 34 0 627083071 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19163] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19163/stat : 19163 (python) S 19023 19025 18999 0 -1 4202560 39 931 0 0 0 0 0 0 18 0 34 0 627083292 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19170] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19170/stat : 19170 (python) S 19023 19025 18999 0 -1 4202560 33 931 0 0 0 0 0 0 19 0 34 0 627093026 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 3 0 0 0
[pid=19025/tid=19176] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19176/stat : 19176 (python) S 19023 19025 18999 0 -1 4202560 36 931 0 0 0 0 0 0 20 0 34 0 627101186 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19179] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19179/stat : 19179 (python) S 19023 19025 18999 0 -1 4202560 37 931 0 0 0 0 0 0 20 0 34 0 627102840 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
[pid=19025/tid=19190] ppid=19023 vsize=683580 CPUtime=0 cores=0-7
/proc/19025/task/19190/stat : 19190 (python) S 19023 19025 18999 0 -1 4202560 35 931 0 0 0 0 0 0 18 0 34 0 627112996 699985920 8045 33554432000 4194304 5683644 140735179420544 18446744073709551615 256427215281 0 0 16781312 2 18446604443705764544 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9517.54
Current children cumulated vsize (KiB) 32613612

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19025 and gives
#  childrusage.ru_utime.tv_sec=1702
#  childrusage.ru_utime.tv_usec=723146
#  childrusage.ru_stime.tv_sec=10
#  childrusage.ru_stime.tv_usec=106463
# CPU time returned by wait4() is 1712.83
# while last known CPU time is 9517.54
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1196.91
CPU time (s): 9517.54
CPU user time (s): 9506.44
CPU system time (s): 11.1
CPU usage (%): 795.178
Max. virtual memory (cumulated for all children) (KiB): 32613612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1702.72
system time used= 10.1065
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 102846
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13845
involuntary context switches= 11250

runsolver used 12.3371 second user time and 27.1939 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-02 22:20:27
IDJOB=3321803
IDBENCH=82581
IDSOLVER=1712
FILE ID=node115/3321803-1304367627
RUNJOBID= node115-1304367627-19013
PBS_JOBID= 13181769
Free space on /tmp= 73500 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S317257086-003-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321803-1304367627/watcher-3321803-1304367627 -o /tmp/evaluation-result-3321803-1304367627/solver-3321803-1304367627 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321803-1304367627.cnf -seed 1968896656 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6f9c7c042784ec486e9e8bc570309805
RANDOM SEED=1968896656

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23613340 kB
Buffers:        900272 kB
Cached:        2616732 kB
SwapCached:          0 kB
Active:        5837260 kB
Inactive:      3038144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23613340 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           32228 kB
Writeback:           0 kB
AnonPages:     5358296 kB
Mapped:          23096 kB
Slab:           372200 kB
PageTables:      26176 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 42092140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73468 MiB
End job on node115 at 2011-05-02 22:40:26