Trace number 3321867

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9678.5 1372.91

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S1163171897-095-UNKNOWN.cnf
MD5SUM9c09330ef9d704e301452237c81ff9c7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.38/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.38/0.67	c INFO: solving HOME/instance-3321867-1304368788.cnf
0.38/0.67	c INFO: computing task features
0.66/0.90	c INFO: computed variable-clause graph statistics
0.66/0.91	c INFO: computed clause balance statistics
1.76/2.09	c INFO: computed variable balance statistics
2.36/2.61	c INFO: computed small-clause counts
2.36/2.61	c INFO: computed Horn-clause counts
2.36/2.65	c INFO: computed variable graph statistics
2.36/2.65	c INFO: collected features for HOME/instance-3321867-1304368788.cnf in 1.98 s
2.36/2.69	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
2.45/2.73	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.13)
2.45/2.77	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.08)
2.55/2.81	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.55/2.84	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.55/2.88	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.04)
2.65/2.92	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.65/2.96	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
702.83/103.02	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
702.83/103.06	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
703.49/103.12	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
705.00/103.34	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
744.66/109.10	c INFO: running hybridGM3@0 for 194 with 39891 remaining (b = 0.03)
787.96/115.28	c INFO: running adaptg2wsat2009++@0 for 97 with 39885 remaining (b = 0.01)
914.32/133.39	c INFO: running hybridGM3@0 for 194 with 39867 remaining (b = 0.03)
1039.33/151.22	c INFO: running hybridGM3@0 for 194 with 39849 remaining (b = 0.02)
1487.97/215.40	c INFO: running TNM@0 for 1552 with 39785 remaining (b = 0.18)
1489.46/215.59	c INFO: running FH@0 for 97 with 39785 remaining (b = 0.01)
1530.63/221.44	c INFO: running adaptg2wsat2009++@0 for 97 with 39779 remaining (b = 0.01)
1660.85/240.08	c INFO: running adaptg2wsat2009++@0 for 97 with 39760 remaining (b = 0.01)
2107.82/299.75	c INFO: running hybridGM3@99 for 97 with 39700 remaining (b = 0.01)
2279.71/323.79	c INFO: running hybridGM3@101 for 97 with 39676 remaining (b = 0.01)
2286.68/324.76	c INFO: running adaptg2wsat2009++@100 for 97 with 39675 remaining (b = 0.01)
2350.82/333.97	c INFO: running hybridGM3@0 for 194 with 39666 remaining (b = 0.02)
2449.79/348.11	c INFO: running hybridGM3@97 for 97 with 39652 remaining (b = 0.01)
2584.40/367.46	c INFO: running hybridGM3@0 for 194 with 39633 remaining (b = 0.02)
2793.66/396.11	c INFO: running hybridGM3@99 for 97 with 39604 remaining (b = 0.01)
2827.81/401.07	c INFO: running hybridGM3@295 for 97 with 39599 remaining (b = 0.01)
3027.88/428.09	c INFO: running TNM@0 for 1552 with 39572 remaining (b = 0.14)
3049.56/431.13	c INFO: running adaptg2wsat2009++@0 for 97 with 39569 remaining (b = 0.01)
3260.64/461.46	c INFO: running adaptg2wsat2009++@99 for 97 with 39539 remaining (b = 0.01)
3518.28/496.38	c INFO: running iPAWS@0 for 97 with 39504 remaining (b = 0.01)
3602.57/508.49	c INFO: running hybridGM3@395 for 97 with 39492 remaining (b = 0.01)
3868.10/546.51	c INFO: running FH@0 for 291 with 39454 remaining (b = 0.03)
4008.93/566.72	c INFO: running gnovelty+2@0 for 97 with 39434 remaining (b = 0.01)
4129.99/582.92	c INFO: running adaptg2wsat2009++@97 for 97 with 39417 remaining (b = 0.01)
4250.53/600.21	c INFO: running hybridGM3@0 for 194 with 39400 remaining (b = 0.02)
4267.97/602.75	c INFO: running FH@99 for 291 with 39397 remaining (b = 0.02)
4582.68/647.94	c INFO: running hybridGM3@0 for 194 with 39352 remaining (b = 0.01)
4751.72/672.22	c INFO: running TNM@0 for 1552 with 39328 remaining (b = 0.11)
4807.37/680.27	c INFO: running adaptg2wsat2009++@297 for 291 with 39320 remaining (b = 0.02)
5660.65/802.91	c INFO: running hybridGM3@99 for 97 with 39197 remaining (b = 0.01)
6161.00/874.74	c INFO: running hybridGM3@100 for 97 with 39126 remaining (b = 0.01)
6186.77/878.44	c INFO: running iPAWS@0 for 97 with 39122 remaining (b = 0.01)
6366.37/904.27	c INFO: running hybridGM3@295 for 194 with 39096 remaining (b = 0.02)
6908.39/982.11	c INFO: running hybridGM3@391 for 97 with 39018 remaining (b = 0.01)
7135.96/1014.89	c INFO: running FH@197 for 194 with 38985 remaining (b = 0.01)
7264.73/1033.35	c INFO: running adaptg2wsat2009++@492 for 97 with 38967 remaining (b = 0.01)
7289.78/1036.94	c INFO: running NCVWr@0 for 485 with 38963 remaining (b = 0.03)
7613.40/1083.47	c INFO: running FH@0 for 97 with 38917 remaining (b = 0.01)
7874.18/1119.91	c INFO: running hybridGM3@392 for 97 with 38880 remaining (b = 0.01)
7983.41/1134.72	c INFO: running iPAWS@0 for 97 with 38866 remaining (b = 0.01)
8450.50/1201.89	c INFO: running adaptg2wsat2009++@97 for 97 with 38798 remaining (b = 0.01)
8714.92/1238.57	c INFO: running FH@196 for 194 with 38762 remaining (b = 0.01)
8765.84/1245.34	c INFO: running hybridGM3@484 for 97 with 38755 remaining (b = 0.01)
8862.68/1259.25	c INFO: running gnovelty+2@0 for 97 with 38741 remaining (b = 0.01)
9250.36/1311.29	c INFO: running hybridGM3@0 for 194 with 38689 remaining (b = 0.01)
9539.34/1352.74	c INFO: running adaptg2wsat2009++@294 for 291 with 38648 remaining (b = 0.02)
9671.47/1371.75	c INFO: running FH@0 for 97 with 38629 remaining (b = 0.01)
9678.50/1372.86	c INFO: running hybridGM3@0 for 194 with 38627 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321867-1304368788/watcher-3321867-1304368788 -o /tmp/evaluation-result-3321867-1304368788/solver-3321867-1304368788 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321867-1304368788.cnf -seed 820002187 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.44 9.41 8.27 3/311 22122
/proc/meminfo: memFree=22427220/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=15908 CPUtime=0 cores=0-7
/proc/22122/stat : 22122 (python) S 22120 22122 21550 0 -1 4202496 959 0 0 0 0 0 0 0 25 0 1 0 627109648 16289792 834 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988590592 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/22122/statm: 3977 834 357 364 0 464 0

[startup+0.090475 s]
/proc/loadavg: 9.44 9.41 8.27 3/311 22122
/proc/meminfo: memFree=22427220/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=84528 CPUtime=0.06 cores=0-7
/proc/22122/stat : 22122 (python) R 22120 22122 21550 0 -1 4202496 2269 0 0 0 4 2 0 0 25 0 1 0 627109648 86556672 2014 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988592384 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22122/statm: 21131 2015 631 364 0 1335 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 84528

[startup+0.10039 s]
/proc/loadavg: 9.44 9.41 8.27 3/311 22122
/proc/meminfo: memFree=22427220/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=89768 CPUtime=0.06 cores=0-7
/proc/22122/stat : 22122 (python) R 22120 22122 21550 0 -1 4202496 2673 0 0 0 4 2 0 0 17 0 1 0 627109648 91922432 2388 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988590592 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22122/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89768

[startup+0.300357 s]
/proc/loadavg: 9.44 9.41 8.27 3/311 22122
/proc/meminfo: memFree=22427220/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=135748 CPUtime=0.19 cores=0-7
/proc/22122/stat : 22122 (python) S 22120 22122 21550 0 -1 4202496 5962 935 1 0 13 6 0 0 18 0 1 0 627109648 139005952 4151 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988588549 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/22122/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700365 s]
/proc/loadavg: 9.44 9.41 8.27 3/311 22122
/proc/meminfo: memFree=22427220/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=280600 CPUtime=0.45 cores=0-7
/proc/22122/stat : 22122 (python) R 22120 22122 21550 0 -1 4202496 9809 935 1 0 32 13 0 0 17 0 1 0 627109648 287334400 7494 33554432000 4194304 5683644 140735610819632 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22122/statm: 70150 7494 1761 364 0 6074 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 280600

[startup+1.50014 s]
/proc/loadavg: 9.44 9.41 8.27 3/312 22127
/proc/meminfo: memFree=22395468/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=289496 CPUtime=1.26 cores=0-7
/proc/22122/stat : 22122 (python) R 22120 22122 21550 0 -1 4202496 13879 935 1 0 112 14 0 0 18 0 1 0 627109648 296443904 9759 33554432000 4194304 5683644 140735610819632 18446744073709551615 4528272 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/22122/statm: 72374 9759 1826 364 0 8298 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 289496

[startup+3.10087 s]
/proc/loadavg: 9.44 9.41 8.27 3/312 22127
/proc/meminfo: memFree=22395724/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=429952 CPUtime=2.72 cores=0-7
/proc/22122/stat : 22122 (python) S 22120 22122 21550 0 -1 4202496 20196 935 1 0 256 16 0 0 24 0 9 0 627109648 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22122/statm: 107488 8182 1891 364 0 43385 0
Current children cumulated CPU time (s) 2.72
Current children cumulated vsize (KiB) 429952

[startup+6.30131 s]
/proc/loadavg: 9.40 9.40 8.27 10/336 22151
/proc/meminfo: memFree=22334244/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=429952 CPUtime=2.72 cores=0-7
/proc/22122/stat : 22122 (python) S 22120 22122 21550 0 -1 4202496 20196 935 1 0 256 16 0 0 24 0 9 0 627109648 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22122/statm: 107488 8182 1891 364 0 43385 0
[pid=22128] ppid=22122 vsize=282236 CPUtime=0 cores=0-7
/proc/22128/stat : 22128 (python) S 22122 22122 21550 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 627109918 289009664 6330 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612623 0 0 16781312 514 3313876648243200257 0 0 17 0 0 0 0
/proc/22128/statm: 70559 6330 355 364 0 6477 0
[pid=22130] ppid=22128 vsize=1020188 CPUtime=3.6 cores=0-7
/proc/22130/stat : 22130 (gnovelty+2) R 22128 22130 22130 0 -1 4202496 1143 0 0 0 360 0 0 0 25 0 1 0 627109918 1044672512 877 33554432000 134512640 135663704 4294616448 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22130/statm: 255047 877 113 282 0 254763 0
[pid=22131] ppid=22122 vsize=293120 CPUtime=0 cores=0-7
/proc/22131/stat : 22131 (python) S 22122 22122 21550 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 627109922 300154880 6367 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 2950478709414396162 0 0 17 0 0 0 0
/proc/22131/statm: 73280 6367 349 364 0 9195 0
[pid=22133] ppid=22131 vsize=1020188 CPUtime=3.56 cores=0-7
/proc/22133/stat : 22133 (gnovelty+2) R 22131 22133 22133 0 -1 4202496 1138 0 0 0 356 0 0 0 25 0 1 0 627109922 1044672512 876 33554432000 134512640 135663704 4286694096 18446744073709551615 134525070 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22133/statm: 255047 876 113 282 0 254763 0
[pid=22134] ppid=22122 vsize=302892 CPUtime=0 cores=0-7
/proc/22134/stat : 22134 (python) S 22122 22122 21550 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 627109926 310161408 6504 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4933684599986290947 0 0 17 6 0 0 0
/proc/22134/statm: 75723 6504 347 364 0 11635 0
[pid=22136] ppid=22134 vsize=421140 CPUtime=3.52 cores=0-7
/proc/22136/stat : 22136 (adaptg2wsat2009) R 22134 22136 22136 0 -1 4202496 1805 0 0 0 352 0 0 0 25 0 1 0 627109926 431247360 1538 33554432000 134512640 135107411 4290287536 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22136/statm: 105285 1538 49 146 0 104161 0
[pid=22137] ppid=22122 vsize=313148 CPUtime=0 cores=0-7
/proc/22137/stat : 22137 (python) S 22122 22122 21550 0 -1 4202560 756 0 0 0 0 0 0 0 18 0 1 0 627109929 320663552 6507 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4279027130471252226 0 0 17 3 0 0 0
/proc/22137/statm: 78287 6507 347 364 0 14196 0
[pid=22139] ppid=22137 vsize=421140 CPUtime=1.86 cores=0-7
/proc/22139/stat : 22139 (adaptg2wsat2009) R 22137 22139 22139 0 -1 4202496 1803 0 0 0 186 0 0 0 25 0 1 0 627109930 431247360 1539 33554432000 134512640 135107411 4289315392 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22139/statm: 105285 1539 49 146 0 104161 0
[pid=22140] ppid=22122 vsize=324000 CPUtime=0 cores=0-7
/proc/22140/stat : 22140 (python) S 22122 22122 21550 0 -1 4202560 763 0 0 0 0 0 0 0 18 0 1 0 627109933 331776000 6514 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 9311724122633371905 0 0 17 3 0 0 0
/proc/22140/statm: 81000 6514 349 364 0 16906 0
[pid=22142] ppid=22140 vsize=421140 CPUtime=3.4 cores=0-7
/proc/22142/stat : 22142 (adaptg2wsat2009) R 22140 22142 22142 0 -1 4202496 1804 0 0 0 340 0 0 0 25 0 1 0 627109934 431247360 1538 33554432000 134512640 135107411 4293527920 18446744073709551615 134523310 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/22142/statm: 105285 1538 49 146 0 104161 0
[pid=22143] ppid=22122 vsize=399196 CPUtime=0 cores=0-7
/proc/22143/stat : 22143 (python) S 22122 22122 21550 0 -1 4202560 727 0 0 0 0 0 0 0 18 0 1 0 627109937 408776704 6689 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 1391419599739650305 0 0 17 3 0 0 0
/proc/22143/statm: 99799 6689 348 364 0 35702 0
[pid=22145] ppid=22143 vsize=1020188 CPUtime=3.37 cores=0-7
/proc/22145/stat : 22145 (gnovelty+2) R 22143 22145 22145 0 -1 4202496 1131 0 0 0 337 0 0 0 25 0 1 0 627109939 1044672512 877 33554432000 134512640 135663704 4291162736 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22145/statm: 255047 877 113 282 0 254763 0
[pid=22146] ppid=22122 vsize=409452 CPUtime=0 cores=0-7
/proc/22146/stat : 22146 (python) S 22122 22122 21550 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 627109941 419278848 6665 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4697202188840042755 0 0 17 4 0 0 0
/proc/22146/statm: 102363 6665 348 364 0 38263 0
[pid=22148] ppid=22146 vsize=249144 CPUtime=3.32 cores=0-7
/proc/22148/stat : 22148 (FH) R 22146 22148 22148 0 -1 4202496 1551 0 0 0 332 0 0 0 25 0 1 0 627109943 255123456 1296 33554432000 134512640 134936988 4289042416 18446744073709551615 134523470 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22148/statm: 62286 1296 37 104 0 61790 0
[pid=22149] ppid=22122 vsize=419708 CPUtime=0 cores=0-7
/proc/22149/stat : 22149 (python) S 22122 22122 21550 0 -1 4202560 768 0 0 0 0 0 0 0 18 0 1 0 627109945 429780992 6641 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4252881568596459779 0 0 17 1 0 0 0
/proc/22149/statm: 104927 6641 354 364 0 40824 0
[pid=22151] ppid=22149 vsize=421140 CPUtime=1.61 cores=0-7
/proc/22151/stat : 22151 (adaptg2wsat2009) R 22149 22151 22151 0 -1 4202496 1802 0 0 0 161 0 0 0 25 0 1 0 627109945 431247360 1539 33554432000 134512640 135107411 4293547472 18446744073709551615 134523304 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22151/statm: 105285 1539 49 146 0 104161 0
[pid=22122/tid=22129] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22129/stat : 22129 (python) S 22120 22122 21550 0 -1 4202560 25 935 0 0 0 0 0 0 22 0 9 0 627109918 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 2 0 0 0
[pid=22122/tid=22132] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22132/stat : 22132 (python) S 22120 22122 21550 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 627109922 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 2 0 0 0
[pid=22122/tid=22135] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22135/stat : 22135 (python) S 22120 22122 21550 0 -1 4202560 20 935 0 0 0 0 0 0 20 0 9 0 627109926 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 6 0 0 0
[pid=22122/tid=22138] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22138/stat : 22138 (python) S 22120 22122 21550 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 9 0 627109930 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 0 0 0 0
[pid=22122/tid=22141] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22141/stat : 22141 (python) S 22120 22122 21550 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 627109933 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 7 0 0 0
[pid=22122/tid=22144] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22144/stat : 22144 (python) S 22120 22122 21550 0 -1 4202560 107 935 0 0 0 0 0 0 21 0 9 0 627109937 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22147] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22147/stat : 22147 (python) S 22120 22122 21550 0 -1 4202560 30 935 0 0 0 0 0 0 23 0 9 0 627109941 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22150] ppid=22120 vsize=429952 CPUtime=0 cores=0-7
/proc/22122/task/22150/stat : 22150 (python) S 22120 22122 21550 0 -1 4202560 91 935 0 0 0 0 0 0 25 0 9 0 627109945 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 26.96
Current children cumulated vsize (KiB) 8167972

[startup+12.7012 s]
/proc/loadavg: 9.37 9.39 8.28 10/336 22151
/proc/meminfo: memFree=22329564/32950940 swapFree=67111364/67111528
[pid=22122] ppid=22120 vsize=429952 CPUtime=2.72 cores=0-7
/proc/22122/stat : 22122 (python) S 22120 22122 21550 0 -1 4202496 20196 935 1 0 256 16 0 0 24 0 9 0 627109648 440270848 8182 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22122/statm: 107488 8182 1891 364 0 43385 0
[pid=22128] ppid=22122 vsize=282236 CPUtime=0 cores=0-7
/proc/22128/stat : 22128 (python) S 22122 22122 21550 0 -1 4202560 893 0 0 0 0 0 0 0 18 0 1 0 627109918 289009664 6353 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612623 0 0 16781312 514 3313876648243200257 0 0 17 0 0 0 0
/proc/22128/statm: 70559 6353 378 364 0 6477 0
[pid=22130] ppid=22128 vsize=1020188 CPUtime=10 cores=0-7
/proc/22130/stat : 22130 (gnovelty+2) R 22128 22130 22130 0 -1 4202496 1143 0 0 0 1000 0 0 0 25 0 1 0 627109918 1044672512 877 33554432000 134512640 135663704 4294616448 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22130/statm: 255047 877 113 282 0 254763 0
[pid=22131] ppid=22122 vsize=293120 CPUtime=0 cores=0-7
/proc/22131/stat : 22131 (python) S 22122 22122 21550 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 627109922 300154880 6390 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 2950478709414396162 0 0 17 0 0 0 0
/proc/22131/statm: 73280 6390 372 364 0 9195 0
[pid=22133] ppid=22131 vsize=1020188 CPUtime=9.96 cores=0-7
/proc/22133/stat : 22133 (gnovelty+2) R 22131 22133 22133 0 -1 4202496 1138 0 0 0 996 0 0 0 25 0 1 0 627109922 1044672512 876 33554432000 134512640 135663704 4286694096 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22133/statm: 255047 876 113 282 0 254763 0
[pid=22134] ppid=22122 vsize=302892 CPUtime=0 cores=0-7
/proc/22134/stat : 22134 (python) S 22122 22122 21550 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 627109926 310161408 6527 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4933684599986290947 0 0 17 6 0 0 0
/proc/22134/statm: 75723 6527 370 364 0 11635 0
[pid=22136] ppid=22134 vsize=421804 CPUtime=9.9 cores=0-7
/proc/22136/stat : 22136 (adaptg2wsat2009) R 22134 22136 22136 0 -1 4202496 2139 0 0 0 990 0 0 0 25 0 1 0 627109926 431927296 1872 33554432000 134512640 135107411 4290287536 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22136/statm: 105451 1872 59 146 0 104327 0
[pid=22137] ppid=22122 vsize=313148 CPUtime=0.01 cores=0-7
/proc/22137/stat : 22137 (python) S 22122 22122 21550 0 -1 4202560 944 0 0 0 0 1 0 0 18 0 1 0 627109929 320663552 6530 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4279027130471252226 0 0 17 3 0 0 0
/proc/22137/statm: 78287 6530 370 364 0 14196 0
[pid=22139] ppid=22137 vsize=421140 CPUtime=5.03 cores=0-7
/proc/22139/stat : 22139 (adaptg2wsat2009) R 22137 22139 22139 0 -1 4202496 1803 0 0 0 503 0 0 0 25 0 1 0 627109930 431247360 1539 33554432000 134512640 135107411 4289315392 18446744073709551615 134523245 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22139/statm: 105285 1539 49 146 0 104161 0
[pid=22140] ppid=22122 vsize=324000 CPUtime=0 cores=0-7
/proc/22140/stat : 22140 (python) S 22122 22122 21550 0 -1 4202560 948 0 0 0 0 0 0 0 18 0 1 0 627109933 331776000 6537 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 9311724122633371905 0 0 17 3 0 0 0
/proc/22140/statm: 81000 6537 372 364 0 16906 0
[pid=22142] ppid=22140 vsize=421804 CPUtime=9.72 cores=0-7
/proc/22142/stat : 22142 (adaptg2wsat2009) R 22140 22142 22142 0 -1 4202496 2137 0 0 0 972 0 0 0 25 0 1 0 627109934 431927296 1871 33554432000 134512640 135107411 4293527920 18446744073709551615 134531584 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/22142/statm: 105451 1871 59 146 0 104327 0
[pid=22143] ppid=22122 vsize=399196 CPUtime=0.01 cores=0-7
/proc/22143/stat : 22143 (python) S 22122 22122 21550 0 -1 4202560 799 0 0 0 1 0 0 0 18 0 1 0 627109937 408776704 6712 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 1391419599739650305 0 0 17 3 0 0 0
/proc/22143/statm: 99799 6712 371 364 0 35702 0
[pid=22145] ppid=22143 vsize=1020188 CPUtime=9.73 cores=0-7
/proc/22145/stat : 22145 (gnovelty+2) R 22143 22145 22145 0 -1 4202496 1131 0 0 0 973 0 0 0 25 0 1 0 627109939 1044672512 877 33554432000 134512640 135663704 4291162736 18446744073709551615 134525271 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22145/statm: 255047 877 113 282 0 254763 0
[pid=22146] ppid=22122 vsize=409452 CPUtime=0 cores=0-7
/proc/22146/stat : 22146 (python) S 22122 22122 21550 0 -1 4202560 812 0 0 0 0 0 0 0 18 0 1 0 627109941 419278848 6688 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 4697202188840042755 0 0 17 4 0 0 0
/proc/22146/statm: 102363 6688 371 364 0 38263 0

################
# More data... #
################

[pid=22221] ppid=22122 vsize=563292 CPUtime=0.28 cores=0-7
/proc/22221/stat : 22221 (python) S 22122 22122 21550 0 -1 4202560 1187 0 0 0 17 11 0 0 19 0 2 0 627159287 576811008 6954 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22221/statm: 140823 6954 407 364 0 76678 0
[pid=22223] ppid=22221 vsize=335996 CPUtime=99.24 cores=0-7
/proc/22223/stat : 22223 (iPAWS) T 22221 22223 22223 0 -1 4202496 2027 0 0 0 9923 1 0 0 25 0 1 0 627159288 344059904 1749 33554432000 134512640 135114423 4288530864 18446744073709551615 134516669 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22223/statm: 83999 1749 59 147 0 83851 0
[pid=22221/tid=22235] ppid=22122 vsize=563292 CPUtime=0 cores=0-7
/proc/22221/task/22235/stat : 22235 (python) S 22122 22122 21550 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 627169915 576811008 6954 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604471096072384 0 0 -1 3 0 0 0
[pid=22227] ppid=22122 vsize=573548 CPUtime=0.28 cores=0-7
/proc/22227/stat : 22227 (python) S 22122 22122 21550 0 -1 4202560 1189 0 0 0 15 13 0 0 19 0 2 0 627166321 587313152 6960 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/22227/statm: 143387 6960 407 364 0 79239 0
[pid=22229] ppid=22227 vsize=1020188 CPUtime=100.85 cores=0-7
/proc/22229/stat : 22229 (gnovelty+2) T 22227 22229 22229 0 -1 4202496 1157 0 0 0 10085 0 0 0 25 0 1 0 627166322 1044672512 876 33554432000 134512640 135663704 4292363152 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/22229/statm: 255047 876 113 282 0 254763 0
[pid=22227/tid=22241] ppid=22122 vsize=573548 CPUtime=0 cores=0-7
/proc/22227/task/22241/stat : 22241 (python) S 22122 22122 21550 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 627176861 587313152 6960 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604468122690688 0 0 -1 7 0 0 0
[pid=22232] ppid=22122 vsize=583804 CPUtime=2.03 cores=0-7
/proc/22232/stat : 22232 (python) S 22122 22122 21550 0 -1 4202560 1210 0 0 0 104 99 0 0 18 0 2 0 627169670 597815296 6981 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/22232/statm: 145951 6981 406 364 0 81800 0
[pid=22234] ppid=22232 vsize=268424 CPUtime=681.2 cores=0-7
/proc/22234/stat : 22234 (hybridGM3) T 22232 22234 22234 0 -1 4202496 5661 0 0 0 68118 2 0 0 25 0 1 0 627169670 274866176 5377 33554432000 134512640 135204385 4287663120 18446744073709551615 134538034 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/22234/statm: 67106 5377 63 169 0 66936 0
[pid=22232/tid=22248] ppid=22122 vsize=583804 CPUtime=0 cores=0-7
/proc/22232/task/22248/stat : 22248 (python) S 22122 22122 21550 0 -1 4202560 92 0 0 0 0 0 0 0 18 0 2 0 627189930 597815296 6981 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604469026760000 0 0 -1 1 0 0 0
[pid=22237] ppid=22122 vsize=594060 CPUtime=1.17 cores=0-7
/proc/22237/stat : 22237 (python) S 22122 22122 21550 0 -1 4202560 1193 0 0 0 65 52 0 0 18 0 2 0 627174442 608317440 6982 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22237/statm: 148515 6982 400 364 0 84361 0
[pid=22239] ppid=22237 vsize=268420 CPUtime=391.94 cores=0-7
/proc/22239/stat : 22239 (hybridGM3) T 22237 22239 22239 0 -1 4202496 5661 0 0 0 39193 1 0 0 25 0 1 0 627174443 274862080 5376 33554432000 134512640 135204385 4289372016 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/22239/statm: 67105 5376 63 169 0 66935 0
[pid=22237/tid=22251] ppid=22122 vsize=594060 CPUtime=0 cores=0-7
/proc/22237/task/22251/stat : 22251 (python) S 22122 22122 21550 0 -1 4202560 89 0 0 0 0 0 0 0 18 0 2 0 627197114 608317440 6982 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604466235051008 0 0 -1 0 0 0 0
[pid=22242] ppid=22122 vsize=604316 CPUtime=1.87 cores=0-7
/proc/22242/stat : 22242 (python) S 22122 22122 21550 0 -1 4202560 1007 0 0 0 93 94 0 0 18 0 1 0 627176871 618819584 7042 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 13991364628286767368 0 0 17 3 0 0 0
/proc/22242/statm: 151079 7042 373 364 0 86922 0
[pid=22244] ppid=22242 vsize=459764 CPUtime=614.74 cores=0-7
/proc/22244/stat : 22244 (TNM) R 22242 22244 22244 0 -1 4202496 1939 0 0 0 61473 1 0 0 25 0 1 0 627176871 470798336 1657 33554432000 134512640 135008748 4292771072 18446744073709551615 134528942 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22244/statm: 114941 1657 46 122 0 113841 0
[pid=22252] ppid=22122 vsize=614572 CPUtime=0.36 cores=0-7
/proc/22252/stat : 22252 (python) S 22122 22122 21550 0 -1 4202560 1211 0 0 0 20 16 0 0 19 0 2 0 627197493 629321728 7081 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22252/statm: 153643 7081 400 364 0 89483 0
[pid=22254] ppid=22252 vsize=335996 CPUtime=97.48 cores=0-7
/proc/22254/stat : 22254 (iPAWS) T 22252 22254 22254 0 -1 4202496 2034 0 0 0 9747 1 0 0 25 0 1 0 627197494 344059904 1750 33554432000 134512640 135114423 4289034736 18446744073709551615 134515584 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22254/statm: 83999 1750 59 147 0 83851 0
[pid=22252/tid=22259] ppid=22122 vsize=614572 CPUtime=0 cores=0-7
/proc/22252/task/22259/stat : 22259 (python) S 22122 22122 21550 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 627211128 629321728 7081 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604465562185920 0 0 -1 0 0 0 0
[pid=22260] ppid=22122 vsize=624828 CPUtime=0.9 cores=0-7
/proc/22260/stat : 22260 (python) S 22122 22122 21550 0 -1 4202560 1033 0 0 0 46 44 0 0 18 0 1 0 627213343 639823872 7063 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 13991364628286767367 0 0 17 2 0 0 0
/proc/22260/statm: 156207 7063 373 364 0 92044 0
[pid=22262] ppid=22260 vsize=421340 CPUtime=294.98 cores=0-7
/proc/22262/stat : 22262 (NCVWr) R 22260 22262 22262 0 -1 4202496 1993 0 0 0 29497 1 0 0 25 0 1 0 627213343 431452160 1712 33554432000 134512640 135113558 4294676496 18446744073709551615 134533745 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/22262/statm: 105335 1712 58 147 0 104210 0
[pid=22265] ppid=22122 vsize=635084 CPUtime=0.31 cores=0-7
/proc/22265/stat : 22265 (python) S 22122 22122 21550 0 -1 4202560 1239 0 0 0 17 14 0 0 19 0 2 0 627217996 650326016 7157 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22265/statm: 158771 7157 406 364 0 94605 0
[pid=22267] ppid=22265 vsize=251296 CPUtime=99.48 cores=0-7
/proc/22267/stat : 22267 (FH) T 22265 22267 22267 0 -1 4202496 1981 0 0 0 9946 2 0 0 25 0 1 0 627217996 257327104 1694 33554432000 134512640 134936988 4294774032 18446744073709551615 134553435 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/22267/statm: 62824 1694 41 104 0 62328 0
[pid=22265/tid=22274] ppid=22122 vsize=635084 CPUtime=0 cores=0-7
/proc/22265/task/22274/stat : 22274 (python) S 22122 22122 21550 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 627229827 650326016 7157 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604465562186816 0 0 -1 7 0 0 0
[pid=22269] ppid=22122 vsize=645340 CPUtime=0.33 cores=0-7
/proc/22269/stat : 22269 (python) S 22122 22122 21550 0 -1 4202560 1250 0 0 0 18 15 0 0 19 0 2 0 627223121 660828160 7280 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22269/statm: 161335 7280 407 364 0 97166 0
[pid=22271] ppid=22269 vsize=335996 CPUtime=102.18 cores=0-7
/proc/22271/stat : 22271 (iPAWS) T 22269 22271 22271 0 -1 4202496 2039 0 0 0 10217 1 0 0 25 0 1 0 627223121 344059904 1752 33554432000 134512640 135114423 4294111632 18446744073709551615 134517054 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/22271/statm: 83999 1752 59 147 0 83851 0
[pid=22269/tid=22276] ppid=22122 vsize=645340 CPUtime=0 cores=0-7
/proc/22269/task/22276/stat : 22276 (python) S 22122 22122 21550 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 627235563 660828160 7280 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604456022899584 0 0 -1 0 0 0 0
[pid=22277] ppid=22122 vsize=655596 CPUtime=0.31 cores=0-7
/proc/22277/stat : 22277 (python) S 22122 22122 21550 0 -1 4202560 1270 0 0 0 18 13 0 0 19 0 2 0 627235573 671330304 7152 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000419275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22277/statm: 163899 7152 406 364 0 99727 0
[pid=22279] ppid=22277 vsize=1020188 CPUtime=98.87 cores=0-7
/proc/22279/stat : 22279 (gnovelty+2) T 22277 22279 22279 0 -1 4202496 1166 0 0 0 9885 2 0 0 25 0 1 0 627235574 1044672512 877 33554432000 134512640 135663704 4294705648 18446744073709551615 134545619 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/22279/statm: 255047 877 113 282 0 254763 0
[pid=22277/tid=22295] ppid=22122 vsize=655596 CPUtime=0 cores=0-7
/proc/22277/task/22295/stat : 22295 (python) S 22122 22122 21550 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 627246812 671330304 7152 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 514 18446604456022896896 0 0 -1 0 0 0 0
[pid=22291] ppid=22122 vsize=665852 CPUtime=0.16 cores=0-7
/proc/22291/stat : 22291 (python) S 22122 22122 21550 0 -1 4202560 1069 0 0 0 8 8 0 0 18 0 1 0 627240778 681832448 7222 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 13991364628286767362 0 0 17 1 0 0 0
/proc/22291/statm: 166463 7222 379 364 0 102288 0
[pid=22293] ppid=22291 vsize=268428 CPUtime=52.75 cores=0-7
/proc/22293/stat : 22293 (hybridGM3) R 22291 22293 22293 0 -1 4202496 5666 0 0 0 5275 0 0 0 25 0 1 0 627240778 274870272 5378 33554432000 134512640 135204385 4290308384 18446744073709551615 134538386 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22293/statm: 67107 5378 63 169 0 66937 0
[pid=22296] ppid=22122 vsize=676108 CPUtime=0 cores=0-7
/proc/22296/stat : 22296 (python) S 22122 22122 21550 0 -1 4202560 923 0 0 0 0 0 0 0 19 0 1 0 627246824 692334592 7201 33554432000 4194304 5683644 140735610819632 18446744073709551615 215988612678 0 0 16781312 514 2076956578442903551 0 0 17 1 0 0 0
/proc/22296/statm: 169027 7201 345 364 0 104849 0
[pid=22298] ppid=22296 vsize=249144 CPUtime=0.51 cores=0-7
/proc/22298/stat : 22298 (FH) R 22296 22298 22298 0 -1 4202496 1589 0 0 0 51 0 0 0 22 0 1 0 627246824 255123456 1296 33554432000 134512640 134936988 4290388576 18446744073709551615 134523337 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22298/statm: 62286 1296 37 104 0 61790 0
[pid=22122/tid=22129] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22129/stat : 22129 (python) S 22120 22122 21550 0 -1 4202560 25 935 0 0 0 0 0 0 22 0 34 0 627109918 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 2 0 0 0
[pid=22122/tid=22132] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22132/stat : 22132 (python) S 22120 22122 21550 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 34 0 627109922 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 2 0 0 0
[pid=22122/tid=22135] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22135/stat : 22135 (python) S 22120 22122 21550 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 627109926 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 6 0 0 0
[pid=22122/tid=22138] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22138/stat : 22138 (python) S 22120 22122 21550 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 34 0 627109930 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 0 0 0 0
[pid=22122/tid=22141] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22141/stat : 22141 (python) S 22120 22122 21550 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 34 0 627109933 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 7 0 0 0
[pid=22122/tid=22144] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22144/stat : 22144 (python) S 22120 22122 21550 0 -1 4202560 107 935 0 0 0 0 0 0 21 0 34 0 627109937 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22147] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22147/stat : 22147 (python) S 22120 22122 21550 0 -1 4202560 41 935 0 0 0 0 0 0 18 0 34 0 627109941 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22150] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22150/stat : 22150 (python) S 22120 22122 21550 0 -1 4202560 97 935 0 0 0 0 0 0 18 0 34 0 627109945 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22157] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22157/stat : 22157 (python) S 22120 22122 21550 0 -1 4202560 66 935 0 0 0 0 0 0 18 0 34 0 627119951 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22159] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22159/stat : 22159 (python) S 22120 22122 21550 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 34 0 627119955 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22164] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22164/stat : 22164 (python) S 22120 22122 21550 0 -1 4202560 55 935 0 0 0 0 0 0 18 0 34 0 627119961 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22168] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22168/stat : 22168 (python) S 22120 22122 21550 0 -1 4202560 35 935 0 0 0 0 0 0 23 0 34 0 627119983 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22173] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22173/stat : 22173 (python) S 22120 22122 21550 0 -1 4202560 43 935 0 0 0 0 0 0 18 0 34 0 627120559 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22177] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22177/stat : 22177 (python) S 22120 22122 21550 0 -1 4202560 55 935 0 0 0 0 0 0 18 0 34 0 627121177 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 2 0 0 0
[pid=22122/tid=22181] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22181/stat : 22181 (python) S 22120 22122 21550 0 -1 4202560 41 935 0 0 0 0 0 0 18 0 34 0 627122988 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22186] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22186/stat : 22186 (python) S 22120 22122 21550 0 -1 4202560 39 935 0 0 0 0 0 0 18 0 34 0 627124771 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22191] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22191/stat : 22191 (python) S 22120 22122 21550 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 34 0 627131189 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22195] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22195/stat : 22195 (python) S 22120 22122 21550 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 34 0 627131209 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22207] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22207/stat : 22207 (python) S 22120 22122 21550 0 -1 4202560 44 935 0 0 0 0 0 0 19 0 34 0 627143046 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22212] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22212/stat : 22212 (python) S 22120 22122 21550 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 34 0 627146395 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22217] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22217/stat : 22217 (python) S 22120 22122 21550 0 -1 4202560 39 935 0 0 0 0 0 0 19 0 34 0 627152458 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22222] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22222/stat : 22222 (python) S 22120 22122 21550 0 -1 4202560 44 935 0 0 0 0 0 0 19 0 34 0 627159287 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22228] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22228/stat : 22228 (python) S 22120 22122 21550 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 34 0 627166321 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22233] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22233/stat : 22233 (python) S 22120 22122 21550 0 -1 4202560 53 935 0 0 0 0 0 0 18 0 34 0 627169670 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 1 0 0 0
[pid=22122/tid=22238] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22238/stat : 22238 (python) S 22120 22122 21550 0 -1 4202560 44 935 0 0 0 0 0 0 18 0 34 0 627174443 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22243] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22243/stat : 22243 (python) S 22120 22122 21550 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 34 0 627176871 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22253] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22253/stat : 22253 (python) S 22120 22122 21550 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 34 0 627197493 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 3 0 0 0
[pid=22122/tid=22261] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22261/stat : 22261 (python) S 22120 22122 21550 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 34 0 627213343 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 1 0 0 0
[pid=22122/tid=22266] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22266/stat : 22266 (python) S 22120 22122 21550 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 34 0 627217996 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 1 0 0 0
[pid=22122/tid=22270] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22270/stat : 22270 (python) S 22120 22122 21550 0 -1 4202560 33 935 0 0 0 0 0 0 19 0 34 0 627223121 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 1 0 0 0
[pid=22122/tid=22278] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22278/stat : 22278 (python) S 22120 22122 21550 0 -1 4202560 37 935 0 0 0 0 0 0 19 0 34 0 627235574 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 1 0 0 0
[pid=22122/tid=22292] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22292/stat : 22292 (python) S 22120 22122 21550 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 34 0 627240778 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
[pid=22122/tid=22297] ppid=22120 vsize=686352 CPUtime=0 cores=0-7
/proc/22122/task/22297/stat : 22297 (python) S 22120 22122 21550 0 -1 4202560 36 935 0 0 0 0 0 0 19 0 34 0 627246824 702824448 8796 33554432000 4194304 5683644 140735610819632 18446744073709551615 216000416177 0 0 16781312 2 18446604449766437120 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9678.5
Current children cumulated vsize (KiB) 32396952

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22122 and gives
#  childrusage.ru_utime.tv_sec=1705
#  childrusage.ru_utime.tv_usec=432734
#  childrusage.ru_stime.tv_sec=11
#  childrusage.ru_stime.tv_usec=550244
# CPU time returned by wait4() is 1716.98
# while last known CPU time is 9678.5
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1372.91
CPU time (s): 9678.5
CPU user time (s): 9664.38
CPU system time (s): 14.12
CPU usage (%): 704.963
Max. virtual memory (cumulated for all children) (KiB): 32396952

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1705.43
system time used= 11.5502
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 107237
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14332
involuntary context switches= 15011

runsolver used 14.3608 second user time and 33.5229 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-02 22:39:49
IDJOB=3321867
IDBENCH=82645
IDSOLVER=1712
FILE ID=node117/3321867-1304368788
RUNJOBID= node117-1304366467-21564
PBS_JOBID= 13181754
Free space on /tmp= 72652 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S1163171897-095-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321867-1304368788/watcher-3321867-1304368788 -o /tmp/evaluation-result-3321867-1304368788/solver-3321867-1304368788 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321867-1304368788.cnf -seed 820002187 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9c09330ef9d704e301452237c81ff9c7
RANDOM SEED=820002187

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      22428376 kB
Buffers:       1023652 kB
Cached:        4525024 kB
SwapCached:        160 kB
Active:        4938096 kB
Inactive:      5078592 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      22428376 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           33016 kB
Writeback:           0 kB
AnonPages:     4468204 kB
Mapped:          25136 kB
Slab:           410276 kB
PageTables:      27788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 58573804 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72620 MiB
End job on node117 at 2011-05-02 23:02:44