Trace number 3321885

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7911 995.605

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S536077088-015-UNKNOWN.cnf
MD5SUM7eb6d5b5c1c99a6b88954b61ac97b4f7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3321885-1304369024.cnf
0.31/0.47	c INFO: computing task features
0.59/0.72	c INFO: computed variable-clause graph statistics
0.59/0.72	c INFO: computed clause balance statistics
1.90/2.04	c INFO: computed variable balance statistics
2.40/2.57	c INFO: computed small-clause counts
2.40/2.57	c INFO: computed Horn-clause counts
2.50/2.61	c INFO: computed variable graph statistics
2.50/2.61	c INFO: collected features for HOME/instance-3321885-1304369024.cnf in 2.13 s
2.50/2.65	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.38)
2.50/2.68	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.13)
2.59/2.72	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.08)
2.59/2.76	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.70/2.80	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.70/2.84	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.04)
2.70/2.88	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.79/2.92	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
802.54/102.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
802.54/102.98	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
803.13/103.03	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
803.13/103.08	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
803.48/103.14	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
803.61/103.20	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.01)
803.61/103.26	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
805.08/103.33	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.02)
1601.01/203.20	c INFO: running TNM@0 for 1552 with 39797 remaining (b = 0.18)
1601.77/203.27	c INFO: running FH@0 for 97 with 39797 remaining (b = 0.01)
1603.37/203.41	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1603.37/203.48	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2370.94/299.75	c INFO: running hybridGM3@99 for 97 with 39700 remaining (b = 0.01)
2371.71/299.89	c INFO: running hybridGM3@99 for 97 with 39700 remaining (b = 0.01)
2378.11/300.67	c INFO: running adaptg2wsat2009++@0 for 97 with 39699 remaining (b = 0.01)
2378.89/300.74	c INFO: running adaptg2wsat2009++@100 for 97 with 39699 remaining (b = 0.01)
2401.20/303.55	c INFO: running hybridGM3@0 for 194 with 39696 remaining (b = 0.02)
2409.95/304.62	c INFO: running hybridGM3@98 for 97 with 39695 remaining (b = 0.01)
2419.54/305.86	c INFO: running hybridGM3@99 for 97 with 39694 remaining (b = 0.01)
3130.51/395.01	c INFO: running hybridGM3@295 for 97 with 39605 remaining (b = 0.01)
3153.64/397.93	c INFO: running hybridGM3@0 for 194 with 39602 remaining (b = 0.02)
3155.28/398.12	c INFO: running TNM@0 for 1552 with 39602 remaining (b = 0.14)
3171.91/400.22	c INFO: running adaptg2wsat2009++@100 for 97 with 39600 remaining (b = 0.01)
3179.09/401.13	c INFO: running iPAWS@0 for 97 with 39599 remaining (b = 0.01)
3209.34/404.92	c INFO: running hybridGM3@298 for 97 with 39595 remaining (b = 0.01)
3937.06/496.30	c INFO: running hybridGM3@393 for 97 with 39504 remaining (b = 0.01)
3947.43/497.51	c INFO: running FH@0 for 291 with 39503 remaining (b = 0.03)
3960.17/499.19	c INFO: running gnovelty+2@0 for 97 with 39501 remaining (b = 0.01)
3960.89/499.29	c INFO: running hybridGM3@396 for 97 with 39501 remaining (b = 0.01)
3978.39/501.43	c INFO: running adaptg2wsat2009++@100 for 97 with 39499 remaining (b = 0.01)
4743.92/597.59	c INFO: running FH@100 for 291 with 39402 remaining (b = 0.02)
4753.44/598.72	c INFO: running iPAWS@0 for 97 with 39401 remaining (b = 0.01)
4759.82/599.54	c INFO: running hybridGM3@97 for 97 with 39401 remaining (b = 0.01)
4760.41/599.63	c INFO: running adaptg2wsat2009++@100 for 97 with 39400 remaining (b = 0.01)
4761.18/599.72	c INFO: running hybridGM3@0 for 194 with 39400 remaining (b = 0.01)
5535.02/696.93	c INFO: running TNM@0 for 1552 with 39303 remaining (b = 0.11)
5543.76/698.04	c INFO: running adaptg2wsat2009++@97 for 97 with 39302 remaining (b = 0.01)
5566.00/700.85	c INFO: running gnovelty+2@0 for 97 with 39299 remaining (b = 0.01)
6245.92/786.21	c INFO: running hybridGM3@0 for 194 with 39214 remaining (b = 0.01)
6318.33/795.36	c INFO: running FH@195 for 194 with 39205 remaining (b = 0.01)
6319.03/795.46	c INFO: running hybridGM3@96 for 97 with 39205 remaining (b = 0.01)
6365.22/801.23	c INFO: running hybridGM3@0 for 194 with 39199 remaining (b = 0.01)
7049.79/887.29	c INFO: running FH@0 for 97 with 39113 remaining (b = 0.01)
7125.39/896.79	c INFO: running hybridGM3@0 for 194 with 39103 remaining (b = 0.01)
7802.72/981.87	c INFO: running hybridGM3@97 for 97 with 39018 remaining (b = 0.01)
7848.89/987.63	c INFO: running NCVWr@0 for 485 with 39012 remaining (b = 0.03)
7906.87/994.91	c INFO: running hybridGM3@0 for 194 with 39005 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321885-1304369024/watcher-3321885-1304369024 -o /tmp/evaluation-result-3321885-1304369024/solver-3321885-1304369024 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321885-1304369024.cnf -seed 638324507 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.64 8.00 6.95 1/252 24042
/proc/meminfo: memFree=23121436/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=15776 CPUtime=0 cores=0-7
/proc/24042/stat : 24042 (python) R 24040 24042 23451 0 -1 4202496 884 0 0 0 0 0 0 0 25 0 1 0 529318283 16154624 766 33554432000 4194304 5683644 140737465254640 18446744073709551615 233509958341 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24042/statm: 3944 767 343 364 0 431 0

[startup+0.0950911 s]
/proc/loadavg: 7.64 8.00 6.95 1/252 24042
/proc/meminfo: memFree=23121436/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=101748 CPUtime=0.07 cores=0-7
/proc/24042/stat : 24042 (python) R 24040 24042 23451 0 -1 4202496 2916 0 0 0 5 2 0 0 25 0 1 0 529318283 104189952 2613 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510297344 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24042/statm: 25437 2614 837 364 0 1737 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 101748

[startup+0.101088 s]
/proc/loadavg: 7.64 8.00 6.95 1/252 24042
/proc/meminfo: memFree=23121436/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=104220 CPUtime=0.07 cores=0-7
/proc/24042/stat : 24042 (python) R 24040 24042 23451 0 -1 4202496 3049 0 0 0 5 2 0 0 25 0 1 0 529318283 106721280 2733 33554432000 4194304 5683644 140737465254640 18446744073709551615 4878720 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24042/statm: 26056 2734 847 364 0 1804 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.30107 s]
/proc/loadavg: 7.64 8.00 6.95 1/252 24042
/proc/meminfo: memFree=23121436/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=166544 CPUtime=0.23 cores=0-7
/proc/24042/stat : 24042 (python) R 24040 24042 23451 0 -1 4202496 6696 932 1 0 17 6 0 0 17 0 1 0 529318283 170541056 4778 33554432000 4194304 5683644 140737465254640 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24042/statm: 41636 4778 1322 364 0 3453 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 166544

[startup+0.700984 s]
/proc/loadavg: 7.64 8.00 6.95 1/252 24042
/proc/meminfo: memFree=23121436/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=288800 CPUtime=0.59 cores=0-7
/proc/24042/stat : 24042 (python) R 24040 24042 23451 0 -1 4202496 11710 932 1 0 51 8 0 0 17 0 1 0 529318283 295731200 9394 33554432000 4194304 5683644 140737465254640 18446744073709551615 47147732387952 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24042/statm: 72200 9395 1761 364 0 8124 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 288800

[startup+1.50084 s]
/proc/loadavg: 7.64 8.00 6.95 2/253 24047
/proc/meminfo: memFree=23088816/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=289496 CPUtime=1.4 cores=0-7
/proc/24042/stat : 24042 (python) R 24040 24042 23451 0 -1 4202496 13880 932 1 0 131 9 0 0 19 0 1 0 529318283 296443904 9759 33554432000 4194304 5683644 140737465254640 18446744073709551615 4942057 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/24042/statm: 72374 9759 1826 364 0 8298 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 289496

[startup+3.10051 s]
/proc/loadavg: 7.64 8.00 6.95 2/253 24047
/proc/meminfo: memFree=23088816/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=364420 CPUtime=2.81 cores=0-7
/proc/24042/stat : 24042 (python) S 24040 24042 23451 0 -1 4202496 20389 932 1 0 270 11 0 0 24 0 9 0 529318283 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24042/statm: 91105 8083 1891 364 0 27002 0
Current children cumulated CPU time (s) 2.81
Current children cumulated vsize (KiB) 364420

[startup+6.30094 s]
/proc/loadavg: 7.10 7.88 6.92 9/277 24071
/proc/meminfo: memFree=23024640/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=364420 CPUtime=2.81 cores=0-7
/proc/24042/stat : 24042 (python) S 24040 24042 23451 0 -1 4202496 20389 932 1 0 270 11 0 0 24 0 9 0 529318283 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24042/statm: 91105 8083 1891 364 0 27002 0
[pid=24048] ppid=24042 vsize=282240 CPUtime=0 cores=0-7
/proc/24048/stat : 24048 (python) S 24042 24042 23451 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 529318548 289013760 6331 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317583 0 0 16781312 514 4419671435216126209 0 0 17 7 0 0 0
/proc/24048/statm: 70560 6331 355 364 0 6478 0
[pid=24050] ppid=24048 vsize=1020188 CPUtime=3.64 cores=0-7
/proc/24050/stat : 24050 (gnovelty+2) R 24048 24050 24050 0 -1 4202496 1139 0 0 0 364 0 0 0 25 0 1 0 529318549 1044672512 876 33554432000 134512640 135663704 4291621648 18446744073709551615 134525302 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/24050/statm: 255047 876 113 282 0 254763 0
[pid=24051] ppid=24042 vsize=293124 CPUtime=0 cores=0-7
/proc/24051/stat : 24051 (python) S 24042 24042 23451 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 529318552 300158976 6368 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4456681546362880258 0 0 17 4 0 0 0
/proc/24051/statm: 73281 6368 349 364 0 9196 0
[pid=24053] ppid=24051 vsize=1020188 CPUtime=3.6 cores=0-7
/proc/24053/stat : 24053 (gnovelty+2) R 24051 24053 24053 0 -1 4202496 1138 0 0 0 360 0 0 0 25 0 1 0 529318552 1044672512 877 33554432000 134512640 135663704 4288844112 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24053/statm: 255047 877 113 282 0 254763 0
[pid=24054] ppid=24042 vsize=302896 CPUtime=0 cores=0-7
/proc/24054/stat : 24054 (python) S 24042 24042 23451 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 529318556 310165504 6505 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4306660881334239492 0 0 17 6 0 0 0
/proc/24054/statm: 75724 6505 347 364 0 11636 0
[pid=24056] ppid=24054 vsize=421140 CPUtime=3.56 cores=0-7
/proc/24056/stat : 24056 (adaptg2wsat2009) R 24054 24056 24056 0 -1 4202496 1805 0 0 0 356 0 0 0 25 0 1 0 529318556 431247360 1538 33554432000 134512640 135107411 4294850912 18446744073709551615 134523300 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24056/statm: 105285 1538 49 146 0 104161 0
[pid=24057] ppid=24042 vsize=313152 CPUtime=0 cores=0-7
/proc/24057/stat : 24057 (python) S 24042 24042 23451 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 529318559 320667648 6508 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 2920522515115639042 0 0 17 4 0 0 0
/proc/24057/statm: 78288 6508 347 364 0 14197 0
[pid=24059] ppid=24057 vsize=421140 CPUtime=3.49 cores=0-7
/proc/24059/stat : 24059 (adaptg2wsat2009) R 24057 24059 24059 0 -1 4202496 1802 0 0 0 349 0 0 0 25 0 1 0 529318560 431247360 1539 33554432000 134512640 135107411 4291236944 18446744073709551615 134523452 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24059/statm: 105285 1539 49 146 0 104161 0
[pid=24060] ppid=24042 vsize=324004 CPUtime=0 cores=0-7
/proc/24060/stat : 24060 (python) S 24042 24042 23451 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 529318563 331780096 6515 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4317697229298041092 0 0 17 2 0 0 0
/proc/24060/statm: 81001 6515 349 364 0 16907 0
[pid=24062] ppid=24060 vsize=421140 CPUtime=3.49 cores=0-7
/proc/24062/stat : 24062 (adaptg2wsat2009) R 24060 24062 24062 0 -1 4202496 1804 0 0 0 349 0 0 0 25 0 1 0 529318564 431247360 1538 33554432000 134512640 135107411 4291206592 18446744073709551615 134523308 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24062/statm: 105285 1538 49 146 0 104161 0
[pid=24063] ppid=24042 vsize=334192 CPUtime=0 cores=0-7
/proc/24063/stat : 24063 (python) S 24042 24042 23451 0 -1 4202560 769 0 0 0 0 0 0 0 18 0 1 0 529318567 342212608 6519 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4523702277633966338 0 0 17 1 0 0 0
/proc/24063/statm: 83548 6519 349 364 0 19451 0
[pid=24065] ppid=24063 vsize=1020188 CPUtime=3.44 cores=0-7
/proc/24065/stat : 24065 (gnovelty+2) R 24063 24065 24065 0 -1 4202496 1140 0 0 0 344 0 0 0 25 0 1 0 529318568 1044672512 876 33554432000 134512640 135663704 4292788096 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/24065/statm: 255047 876 113 282 0 254763 0
[pid=24066] ppid=24042 vsize=343920 CPUtime=0 cores=0-7
/proc/24066/stat : 24066 (python) S 24042 24042 23451 0 -1 4202560 770 0 0 0 0 0 0 0 18 0 1 0 529318571 352174080 6532 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4424351506459754756 0 0 17 6 0 0 0
/proc/24066/statm: 85980 6532 347 364 0 21880 0
[pid=24068] ppid=24066 vsize=249144 CPUtime=3.4 cores=0-7
/proc/24068/stat : 24068 (FH) R 24066 24068 24068 0 -1 4202496 1560 0 0 0 340 0 0 0 25 0 1 0 529318572 255123456 1296 33554432000 134512640 134936988 4289163616 18446744073709551615 134523497 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24068/statm: 62286 1296 37 104 0 61790 0
[pid=24069] ppid=24042 vsize=354176 CPUtime=0 cores=0-7
/proc/24069/stat : 24069 (python) S 24042 24042 23451 0 -1 4202560 806 0 0 0 0 0 0 0 18 0 1 0 529318576 362676224 6541 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4317580131309682948 0 0 17 6 0 0 0
/proc/24069/statm: 88544 6541 353 364 0 24441 0
[pid=24071] ppid=24069 vsize=421140 CPUtime=3.33 cores=0-7
/proc/24071/stat : 24071 (adaptg2wsat2009) R 24069 24071 24071 0 -1 4202496 1809 0 0 0 333 0 0 0 25 0 1 0 529318576 431247360 1538 33554432000 134512640 135107411 4293794848 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/24071/statm: 105285 1538 49 146 0 104161 0
[pid=24042/tid=24049] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24049/stat : 24049 (python) S 24040 24042 23451 0 -1 4202560 27 932 0 0 0 0 0 0 22 0 9 0 529318548 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24052] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24052/stat : 24052 (python) S 24040 24042 23451 0 -1 4202560 23 932 0 0 0 0 0 0 24 0 9 0 529318552 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 4 0 0 0
[pid=24042/tid=24055] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24055/stat : 24055 (python) S 24040 24042 23451 0 -1 4202560 19 932 0 0 0 0 0 0 25 0 9 0 529318556 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24058] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24058/stat : 24058 (python) S 24040 24042 23451 0 -1 4202560 25 932 0 0 0 0 0 0 25 0 9 0 529318560 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 4 0 0 0
[pid=24042/tid=24061] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24061/stat : 24061 (python) S 24040 24042 23451 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 9 0 529318564 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 4 0 0 0
[pid=24042/tid=24064] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24064/stat : 24064 (python) S 24040 24042 23451 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 9 0 529318568 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 2 0 0 0
[pid=24042/tid=24067] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24067/stat : 24067 (python) S 24040 24042 23451 0 -1 4202560 26 932 0 0 0 0 0 0 22 0 9 0 529318572 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24070] ppid=24040 vsize=364420 CPUtime=0 cores=0-7
/proc/24042/task/24070/stat : 24070 (python) S 24040 24042 23451 0 -1 4202560 85 932 0 0 0 0 0 0 25 0 9 0 529318576 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 30.76
Current children cumulated vsize (KiB) 7906392

[startup+12.7018 s]
/proc/loadavg: 7.18 7.88 6.92 9/277 24071
/proc/meminfo: memFree=23017160/32951124 swapFree=67111524/67111528
[pid=24042] ppid=24040 vsize=364420 CPUtime=2.81 cores=0-7
/proc/24042/stat : 24042 (python) S 24040 24042 23451 0 -1 4202496 20389 932 1 0 270 11 0 0 24 0 9 0 529318283 373166080 8083 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24042/statm: 91105 8083 1891 364 0 27002 0
[pid=24048] ppid=24042 vsize=282240 CPUtime=0 cores=0-7
/proc/24048/stat : 24048 (python) S 24042 24042 23451 0 -1 4202560 904 0 0 0 0 0 0 0 18 0 1 0 529318548 289013760 6354 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317583 0 0 16781312 514 4419671435216126209 0 0 17 7 0 0 0
/proc/24048/statm: 70560 6354 378 364 0 6478 0
[pid=24050] ppid=24048 vsize=1020188 CPUtime=10.04 cores=0-7
/proc/24050/stat : 24050 (gnovelty+2) R 24048 24050 24050 0 -1 4202496 1139 0 0 0 1004 0 0 0 25 0 1 0 529318549 1044672512 876 33554432000 134512640 135663704 4291621648 18446744073709551615 134547169 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/24050/statm: 255047 876 113 282 0 254763 0
[pid=24051] ppid=24042 vsize=293124 CPUtime=0 cores=0-7
/proc/24051/stat : 24051 (python) S 24042 24042 23451 0 -1 4202560 911 0 0 0 0 0 0 0 18 0 1 0 529318552 300158976 6391 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4456681546362880258 0 0 17 4 0 0 0
/proc/24051/statm: 73281 6391 372 364 0 9196 0
[pid=24053] ppid=24051 vsize=1020188 CPUtime=10 cores=0-7
/proc/24053/stat : 24053 (gnovelty+2) R 24051 24053 24053 0 -1 4202496 1138 0 0 0 1000 0 0 0 25 0 1 0 529318552 1044672512 877 33554432000 134512640 135663704 4288844112 18446744073709551615 134524526 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24053/statm: 255047 877 113 282 0 254763 0
[pid=24054] ppid=24042 vsize=302896 CPUtime=0 cores=0-7
/proc/24054/stat : 24054 (python) S 24042 24042 23451 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 529318556 310165504 6527 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4306660881334239492 0 0 17 6 0 0 0
/proc/24054/statm: 75724 6527 369 364 0 11636 0
[pid=24056] ppid=24054 vsize=421804 CPUtime=9.96 cores=0-7
/proc/24056/stat : 24056 (adaptg2wsat2009) R 24054 24056 24056 0 -1 4202496 2138 0 0 0 996 0 0 0 25 0 1 0 529318556 431927296 1871 33554432000 134512640 135107411 4294850912 18446744073709551615 134532036 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24056/statm: 105451 1871 59 146 0 104327 0
[pid=24057] ppid=24042 vsize=313152 CPUtime=0 cores=0-7
/proc/24057/stat : 24057 (python) S 24042 24042 23451 0 -1 4202560 947 0 0 0 0 0 0 0 18 0 1 0 529318559 320667648 6531 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 2920522515115639042 0 0 17 4 0 0 0
/proc/24057/statm: 78288 6531 370 364 0 14197 0
[pid=24059] ppid=24057 vsize=421804 CPUtime=9.82 cores=0-7
/proc/24059/stat : 24059 (adaptg2wsat2009) R 24057 24059 24059 0 -1 4202496 2135 0 0 0 982 0 0 0 25 0 1 0 529318560 431927296 1872 33554432000 134512640 135107411 4291236944 18446744073709551615 134531736 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24059/statm: 105451 1872 59 146 0 104327 0
[pid=24060] ppid=24042 vsize=324004 CPUtime=0 cores=0-7
/proc/24060/stat : 24060 (python) S 24042 24042 23451 0 -1 4202560 943 0 0 0 0 0 0 0 18 0 1 0 529318563 331780096 6538 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4317697229298041092 0 0 17 2 0 0 0
/proc/24060/statm: 81001 6538 372 364 0 16907 0
[pid=24062] ppid=24060 vsize=421804 CPUtime=9.86 cores=0-7
/proc/24062/stat : 24062 (adaptg2wsat2009) R 24060 24062 24062 0 -1 4202496 2137 0 0 0 986 0 0 0 25 0 1 0 529318564 431927296 1871 33554432000 134512640 135107411 4291206592 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24062/statm: 105451 1871 59 146 0 104327 0
[pid=24063] ppid=24042 vsize=334192 CPUtime=0.01 cores=0-7
/proc/24063/stat : 24063 (python) S 24042 24042 23451 0 -1 4202560 966 0 0 0 0 1 0 0 18 0 1 0 529318567 342212608 6542 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4523702277633966338 0 0 17 1 0 0 0
/proc/24063/statm: 83548 6542 372 364 0 19451 0
[pid=24065] ppid=24063 vsize=1020188 CPUtime=9.83 cores=0-7
/proc/24065/stat : 24065 (gnovelty+2) R 24063 24065 24065 0 -1 4202496 1140 0 0 0 983 0 0 0 25 0 1 0 529318568 1044672512 876 33554432000 134512640 135663704 4292788096 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/24065/statm: 255047 876 113 282 0 254763 0
[pid=24066] ppid=24042 vsize=343920 CPUtime=0 cores=0-7
/proc/24066/stat : 24066 (python) S 24042 24042 23451 0 -1 4202560 968 0 0 0 0 0 0 0 18 0 1 0 529318571 352174080 6555 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4424351506459754756 0 0 17 6 0 0 0
/proc/24066/statm: 85980 6555 370 364 0 21880 0

################
# More data... #
################

[pid=24141] ppid=24139 vsize=335996 CPUtime=99.97 cores=0-7
/proc/24141/stat : 24141 (iPAWS) T 24139 24141 24141 0 -1 4202496 2026 0 0 0 9997 0 0 0 25 0 1 0 529358397 344059904 1750 33554432000 134512640 135114423 4293276784 18446744073709551615 134515504 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24141/statm: 83999 1750 59 147 0 83851 0
[pid=24139/tid=24148] ppid=24042 vsize=563632 CPUtime=0 cores=0-7
/proc/24139/task/24148/stat : 24148 (python) S 24042 24042 23451 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 529368418 577159168 6976 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604471140880512 0 0 -1 2 0 0 0
[pid=24145] ppid=24042 vsize=573888 CPUtime=0.22 cores=0-7
/proc/24145/stat : 24145 (python) S 24042 24042 23451 0 -1 4202560 1176 0 0 0 10 12 0 0 19 0 2 0 529368203 587661312 7013 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/24145/statm: 143472 7013 407 364 0 79324 0
[pid=24147] ppid=24145 vsize=1020188 CPUtime=99.82 cores=0-7
/proc/24147/stat : 24147 (gnovelty+2) T 24145 24147 24147 0 -1 4202496 1157 0 0 0 9982 0 0 0 25 0 1 0 529368203 1044672512 876 33554432000 134512640 135663704 4287036848 18446744073709551615 134524916 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/24147/statm: 255047 876 113 282 0 254763 0
[pid=24145/tid=24156] ppid=24042 vsize=573888 CPUtime=0 cores=0-7
/proc/24145/task/24156/stat : 24156 (python) S 24042 24042 23451 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 529378230 587661312 7013 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604468134565824 0 0 -1 1 0 0 0
[pid=24152] ppid=24042 vsize=584144 CPUtime=0.22 cores=0-7
/proc/24152/stat : 24152 (python) S 24042 24042 23451 0 -1 4202560 1195 0 0 0 10 12 0 0 19 0 2 0 529378156 598163456 7018 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/24152/statm: 146036 7018 406 364 0 81885 0
[pid=24154] ppid=24152 vsize=335996 CPUtime=99.19 cores=0-7
/proc/24154/stat : 24154 (iPAWS) T 24152 24154 24154 0 -1 4202496 2029 0 0 0 9919 0 0 0 25 0 1 0 529378156 344059904 1749 33554432000 134512640 135114423 4288071456 18446744073709551615 134515117 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/24154/statm: 83999 1749 59 147 0 83851 0
[pid=24152/tid=24166] ppid=24042 vsize=584144 CPUtime=0 cores=0-7
/proc/24152/task/24166/stat : 24166 (python) S 24042 24042 23451 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 529388078 598163456 7018 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604454223471552 0 0 -1 5 0 0 0
[pid=24157] ppid=24042 vsize=595292 CPUtime=0.67 cores=0-7
/proc/24157/stat : 24157 (python) S 24042 24042 23451 0 -1 4202560 1279 0 0 0 36 31 0 0 18 0 2 0 529378256 609579008 7081 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/24157/statm: 148823 7081 401 364 0 84669 0
[pid=24159] ppid=24157 vsize=268420 CPUtime=295.18 cores=0-7
/proc/24159/stat : 24159 (hybridGM3) T 24157 24159 24159 0 -1 4202496 5666 0 0 0 29516 2 0 0 25 0 1 0 529378256 274862080 5377 33554432000 134512640 135204385 4292869392 18446744073709551615 134538541 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24159/statm: 67105 5377 63 169 0 66935 0
[pid=24157/tid=24175] ppid=24042 vsize=595292 CPUtime=0 cores=0-7
/proc/24157/task/24175/stat : 24175 (python) S 24042 24042 23451 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 529397809 609579008 7081 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604470887847104 0 0 -1 0 0 0 0
[pid=24163] ppid=24042 vsize=605748 CPUtime=0.68 cores=0-7
/proc/24163/stat : 24163 (python) S 24042 24042 23451 0 -1 4202560 1125 0 0 0 33 35 0 0 18 0 1 0 529387976 620285952 7114 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 7839816973205602564 0 0 17 0 0 0 0
/proc/24163/statm: 151437 7114 373 364 0 87280 0
[pid=24165] ppid=24163 vsize=459764 CPUtime=298.43 cores=0-7
/proc/24165/stat : 24165 (TNM) R 24163 24165 24165 0 -1 4202496 1941 0 0 0 29843 0 0 0 25 0 1 0 529387977 470798336 1657 33554432000 134512640 135008748 4293254176 18446744073709551615 134529387 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/24165/statm: 114941 1657 46 122 0 113841 0
[pid=24167] ppid=24042 vsize=616028 CPUtime=0.22 cores=0-7
/proc/24167/stat : 24167 (python) S 24042 24042 23451 0 -1 4202560 1267 0 0 0 10 12 0 0 19 0 2 0 529388369 630812672 7154 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/24167/statm: 154007 7154 401 364 0 89847 0
[pid=24169] ppid=24167 vsize=1020188 CPUtime=99.85 cores=0-7
/proc/24169/stat : 24169 (gnovelty+2) T 24167 24169 24169 0 -1 4202496 1161 0 0 0 9985 0 0 0 25 0 1 0 529388369 1044672512 876 33554432000 134512640 135663704 4289863104 18446744073709551615 134524534 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24169/statm: 255047 876 113 282 0 254763 0
[pid=24167/tid=24176] ppid=24042 vsize=616028 CPUtime=0 cores=0-7
/proc/24167/task/24176/stat : 24176 (python) S 24042 24042 23451 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 529398396 630812672 7154 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604462407914752 0 0 -1 2 0 0 0
[pid=24172] ppid=24042 vsize=626080 CPUtime=0.48 cores=0-7
/proc/24172/stat : 24172 (python) S 24042 24042 23451 0 -1 4202560 1307 0 0 0 25 23 0 0 18 0 2 0 529396904 641105920 7159 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/24172/statm: 156520 7159 402 364 0 92357 0
[pid=24174] ppid=24172 vsize=268420 CPUtime=208.46 cores=0-7
/proc/24174/stat : 24174 (hybridGM3) R 24172 24174 24174 0 -1 4202496 5667 0 0 0 20845 1 0 0 25 0 1 0 529396905 274862080 5377 33554432000 134512640 135204385 4291003136 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/24174/statm: 67105 5377 63 169 0 66935 0
[pid=24172/tid=24191] ppid=24042 vsize=626080 CPUtime=0 cores=0-7
/proc/24172/task/24191/stat : 24191 (python) S 24042 24042 23451 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 529416459 641105920 7159 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604462407915648 0 0 -1 2 0 0 0
[pid=24177] ppid=24042 vsize=636016 CPUtime=0.44 cores=0-7
/proc/24177/stat : 24177 (python) S 24042 24042 23451 0 -1 4202560 1029 0 0 0 23 21 0 0 18 0 1 0 529398407 651280384 7218 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 7839816973205602565 0 0 17 5 0 0 0
/proc/24177/statm: 159004 7218 378 364 0 94838 0
[pid=24179] ppid=24177 vsize=268428 CPUtime=193.06 cores=0-7
/proc/24179/stat : 24179 (hybridGM3) R 24177 24179 24179 0 -1 4202496 5666 0 0 0 19303 3 0 0 25 0 1 0 529398407 274870272 5378 33554432000 134512640 135204385 4291265872 18446744073709551615 134538191 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/24179/statm: 67107 5378 63 169 0 66937 0
[pid=24183] ppid=24042 vsize=646272 CPUtime=0.24 cores=0-7
/proc/24183/stat : 24183 (python) S 24042 24042 23451 0 -1 4202560 1240 0 0 0 10 14 0 0 19 0 2 0 529407012 661782528 7342 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/24183/statm: 161568 7342 407 364 0 97399 0
[pid=24185] ppid=24183 vsize=251292 CPUtime=99.72 cores=0-7
/proc/24185/stat : 24185 (FH) T 24183 24185 24185 0 -1 4202496 1978 0 0 0 9972 0 0 0 25 0 1 0 529407013 257323008 1693 33554432000 134512640 134936988 4288187024 18446744073709551615 134546278 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24185/statm: 62823 1693 41 104 0 62327 0
[pid=24183/tid=24192] ppid=24042 vsize=646272 CPUtime=0 cores=0-7
/proc/24183/task/24192/stat : 24192 (python) S 24042 24042 23451 0 -1 4202560 107 0 0 0 0 0 0 0 19 0 2 0 529417035 661782528 7342 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 514 18446604462478996800 0 0 -1 2 0 0 0
[pid=24186] ppid=24042 vsize=656528 CPUtime=0.22 cores=0-7
/proc/24186/stat : 24186 (python) S 24042 24042 23451 0 -1 4202560 1041 0 0 0 11 11 0 0 18 0 1 0 529407963 672284672 7278 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 7839816973205602564 0 0 17 5 0 0 0
/proc/24186/statm: 164132 7278 379 364 0 99960 0
[pid=24188] ppid=24186 vsize=268428 CPUtime=94.55 cores=0-7
/proc/24188/stat : 24188 (hybridGM3) R 24186 24188 24188 0 -1 4202496 5665 0 0 0 9454 1 0 0 25 0 1 0 529407963 274870272 5378 33554432000 134512640 135204385 4291720992 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/24188/statm: 67107 5378 63 169 0 66937 0
[pid=24193] ppid=24042 vsize=666784 CPUtime=0 cores=0-7
/proc/24193/stat : 24193 (python) S 24042 24042 23451 0 -1 4202560 1047 0 0 0 0 0 0 0 18 0 1 0 529417047 682786816 7274 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 4505704921554714884 0 0 17 5 0 0 0
/proc/24193/statm: 166696 7274 378 364 0 102521 0
[pid=24195] ppid=24193 vsize=421344 CPUtime=7.73 cores=0-7
/proc/24195/stat : 24195 (NCVWr) R 24193 24195 24195 0 -1 4202496 1999 0 0 0 773 0 0 0 25 0 1 0 529417047 431456256 1713 33554432000 134512640 135113558 4292693648 18446744073709551615 134531911 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24195/statm: 105336 1713 58 147 0 104211 0
[pid=24197] ppid=24042 vsize=677040 CPUtime=0 cores=0-7
/proc/24197/stat : 24197 (python) S 24042 24042 23451 0 -1 4202560 940 0 0 0 0 0 0 0 20 0 1 0 529417774 693288960 7203 33554432000 4194304 5683644 140737465254640 18446744073709551615 233510317638 0 0 16781312 514 5632227151978692607 0 0 17 5 0 0 0
/proc/24197/statm: 169260 7203 350 364 0 105082 0
[pid=24199] ppid=24197 vsize=268420 CPUtime=0.5 cores=0-7
/proc/24199/stat : 24199 (hybridGM3) R 24197 24199 24199 0 -1 4202496 5666 0 0 0 50 0 0 0 23 0 1 0 529417775 274862080 5377 33554432000 134512640 135204385 4286569424 18446744073709551615 134538248 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24199/statm: 67105 5377 63 169 0 66935 0
[pid=24042/tid=24049] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24049/stat : 24049 (python) S 24040 24042 23451 0 -1 4202560 27 932 0 0 0 0 0 0 22 0 34 0 529318548 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24052] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24052/stat : 24052 (python) S 24040 24042 23451 0 -1 4202560 23 932 0 0 0 0 0 0 24 0 34 0 529318552 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 4 0 0 0
[pid=24042/tid=24055] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24055/stat : 24055 (python) S 24040 24042 23451 0 -1 4202560 27 932 0 0 0 0 0 0 16 0 34 0 529318556 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24058] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24058/stat : 24058 (python) S 24040 24042 23451 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 34 0 529318560 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 4 0 0 0
[pid=24042/tid=24061] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24061/stat : 24061 (python) S 24040 24042 23451 0 -1 4202560 33 932 0 0 0 0 0 0 18 0 34 0 529318564 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 1 0 0 0
[pid=24042/tid=24064] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24064/stat : 24064 (python) S 24040 24042 23451 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 34 0 529318568 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 2 0 0 0
[pid=24042/tid=24067] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24067/stat : 24067 (python) S 24040 24042 23451 0 -1 4202560 36 932 0 0 0 0 0 0 18 0 34 0 529318572 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24070] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24070/stat : 24070 (python) S 24040 24042 23451 0 -1 4202560 89 932 0 0 0 0 0 0 18 0 34 0 529318576 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 6 0 0 0
[pid=24042/tid=24079] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24079/stat : 24079 (python) S 24040 24042 23451 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 34 0 529328577 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 7 0 0 0
[pid=24042/tid=24084] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24084/stat : 24084 (python) S 24040 24042 23451 0 -1 4202560 33 932 0 0 0 0 0 0 18 0 34 0 529328582 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 7 0 0 0
[pid=24042/tid=24087] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24087/stat : 24087 (python) S 24040 24042 23451 0 -1 4202560 44 932 0 0 0 0 0 0 18 0 34 0 529328587 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 7 0 0 0
[pid=24042/tid=24092] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24092/stat : 24092 (python) S 24040 24042 23451 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 34 0 529328592 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 4 0 0 0
[pid=24042/tid=24096] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24096/stat : 24096 (python) S 24040 24042 23451 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 34 0 529328598 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 3 0 0 0
[pid=24042/tid=24099] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24099/stat : 24099 (python) S 24040 24042 23451 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 34 0 529328604 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 3 0 0 0
[pid=24042/tid=24102] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24102/stat : 24102 (python) S 24040 24042 23451 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 34 0 529328610 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 3 0 0 0
[pid=24042/tid=24105] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24105/stat : 24105 (python) S 24040 24042 23451 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 34 0 529328616 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 1 0 0 0
[pid=24042/tid=24112] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24112/stat : 24112 (python) S 24040 24042 23451 0 -1 4202560 20 932 0 0 0 0 0 0 19 0 34 0 529338604 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 2 0 0 0
[pid=24042/tid=24115] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24115/stat : 24115 (python) S 24040 24042 23451 0 -1 4202560 29 932 0 0 0 0 0 0 21 0 34 0 529338611 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 1 0 0 0
[pid=24042/tid=24126] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24126/stat : 24126 (python) S 24040 24042 23451 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 34 0 529348639 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
[pid=24042/tid=24134] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24134/stat : 24134 (python) S 24040 24042 23451 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 34 0 529358077 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
[pid=24042/tid=24137] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24137/stat : 24137 (python) S 24040 24042 23451 0 -1 4202560 37 932 0 0 0 0 0 0 19 0 34 0 529358096 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 1 0 0 0
[pid=24042/tid=24140] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24140/stat : 24140 (python) S 24040 24042 23451 0 -1 4202560 41 932 0 0 0 0 0 0 20 0 34 0 529358397 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 1 0 0 0
[pid=24042/tid=24146] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24146/stat : 24146 (python) S 24040 24042 23451 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 34 0 529368203 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 1 0 0 0
[pid=24042/tid=24153] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24153/stat : 24153 (python) S 24040 24042 23451 0 -1 4202560 46 932 0 0 0 0 0 0 20 0 34 0 529378156 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
[pid=24042/tid=24158] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24158/stat : 24158 (python) S 24040 24042 23451 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 34 0 529378256 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 5 0 0 0
[pid=24042/tid=24164] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24164/stat : 24164 (python) S 24040 24042 23451 0 -1 4202560 28 932 0 0 0 0 0 0 19 0 34 0 529387977 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 5 0 0 0
[pid=24042/tid=24168] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24168/stat : 24168 (python) S 24040 24042 23451 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 34 0 529388369 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 5 0 0 0
[pid=24042/tid=24173] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24173/stat : 24173 (python) S 24040 24042 23451 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 34 0 529396905 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
[pid=24042/tid=24178] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24178/stat : 24178 (python) S 24040 24042 23451 0 -1 4202560 121 932 0 0 0 0 0 0 20 0 34 0 529398407 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 5 0 0 0
[pid=24042/tid=24184] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24184/stat : 24184 (python) S 24040 24042 23451 0 -1 4202560 37 932 0 0 0 0 0 0 20 0 34 0 529407013 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
[pid=24042/tid=24187] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24187/stat : 24187 (python) S 24040 24042 23451 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 34 0 529407963 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 5 0 0 0
[pid=24042/tid=24194] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24194/stat : 24194 (python) S 24040 24042 23451 0 -1 4202560 38 932 0 0 0 0 0 0 20 0 34 0 529417047 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
[pid=24042/tid=24198] ppid=24040 vsize=687284 CPUtime=0 cores=0-7
/proc/24042/task/24198/stat : 24198 (python) S 24040 24042 23451 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 34 0 529417775 703778816 8799 33554432000 4194304 5683644 140737465254640 18446744073709551615 233522121137 0 0 16781312 2 18446604453965273280 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7911
Current children cumulated vsize (KiB) 31974692

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24042 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=492013
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=235964
# CPU time returned by wait4() is 6.72798
# while last known CPU time is 7911
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 995.605
CPU time (s): 7911
CPU user time (s): 7902.4
CPU system time (s): 8.6
CPU usage (%): 794.592
Max. virtual memory (cumulated for all children) (KiB): 31974692

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.49201
system time used= 0.235964
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 64032
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1893
involuntary context switches= 80

runsolver used 9.68653 second user time and 21.0218 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-02 22:43:44
IDJOB=3321885
IDBENCH=82663
IDSOLVER=1712
FILE ID=node145/3321885-1304369024
RUNJOBID= node145-1304366464-23465
PBS_JOBID= 13181729
Free space on /tmp= 73636 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S536077088-015-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321885-1304369024/watcher-3321885-1304369024 -o /tmp/evaluation-result-3321885-1304369024/solver-3321885-1304369024 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321885-1304369024.cnf -seed 638324507 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7eb6d5b5c1c99a6b88954b61ac97b4f7
RANDOM SEED=638324507

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23121716 kB
Buffers:       1327628 kB
Cached:        6052576 kB
SwapCached:          4 kB
Active:        4293100 kB
Inactive:      4978212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23121716 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           33172 kB
Writeback:          36 kB
AnonPages:     1890932 kB
Mapped:          20596 kB
Slab:           475796 kB
PageTables:      17420 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38155724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73604 MiB
End job on node145 at 2011-05-02 23:00:22