Trace number 3321908

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7886.4 996.717

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S625465881-078-UNKNOWN.cnf
MD5SUM3ba69e7f651721ce4358ca0320f27486
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark363.637
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3321908-1304369340.cnf
0.32/0.47	c INFO: computing task features
0.82/0.98	c INFO: computed variable-clause graph statistics
0.82/1.00	c INFO: computed clause balance statistics
3.52/3.62	c INFO: computed variable balance statistics
5.72/5.84	c INFO: computed small-clause counts
5.72/5.85	c INFO: computed Horn-clause counts
7.32/7.41	c INFO: computed variable graph statistics
7.32/7.41	c INFO: collected features for HOME/instance-3321908-1304369340.cnf in 6.92 s
7.32/7.45	c INFO: running hybridGM3@0 for 97 with 39993 remaining (b = 0.36)
7.32/7.49	c INFO: running hybridGM3@0 for 97 with 39993 remaining (b = 0.21)
7.41/7.53	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.14)
7.41/7.57	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.18)
7.85/7.61	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.14)
7.85/7.66	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.11)
7.85/7.70	c INFO: running TNM@0 for 97 with 39992 remaining (b = 0.04)
8.36/7.74	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.07)
807.71/107.81	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
807.71/107.86	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
808.42/107.90	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
809.19/108.03	c INFO: running hybridGM3@0 for 194 with 39892 remaining (b = 0.06)
1567.23/203.06	c INFO: running hybridGM3@100 for 97 with 39797 remaining (b = 0.03)
1568.04/203.11	c INFO: running hybridGM3@100 for 97 with 39797 remaining (b = 0.03)
1568.04/203.15	c INFO: running hybridGM3@100 for 97 with 39797 remaining (b = 0.03)
1575.97/204.14	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.03)
1576.75/204.20	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.03)
1577.55/204.34	c INFO: running hybridGM3@100 for 97 with 39796 remaining (b = 0.03)
1624.55/210.25	c INFO: running hybridGM3@0 for 97 with 39790 remaining (b = 0.03)
2335.59/299.39	c INFO: running hybridGM3@0 for 194 with 39701 remaining (b = 0.04)
2375.48/304.33	c INFO: running TNM@0 for 97 with 39696 remaining (b = 0.02)
2375.48/304.39	c INFO: running hybridGM3@0 for 194 with 39696 remaining (b = 0.03)
2376.19/304.45	c INFO: running hybridGM3@296 for 97 with 39696 remaining (b = 0.02)
2377.80/304.67	c INFO: running hybridGM3@94 for 97 with 39695 remaining (b = 0.02)
2384.11/305.48	c INFO: running TNM@0 for 1940 with 39695 remaining (b = 0.22)
2384.88/305.53	c INFO: running hybridGM3@95 for 97 with 39694 remaining (b = 0.02)
2385.65/305.62	c INFO: running hybridGM3@299 for 97 with 39694 remaining (b = 0.02)
3136.52/399.73	c INFO: running hybridGM3@0 for 194 with 39600 remaining (b = 0.03)
3145.27/400.89	c INFO: running TNM@0 for 97 with 39599 remaining (b = 0.01)
3175.56/404.67	c INFO: running hybridGM3@394 for 97 with 39595 remaining (b = 0.01)
3186.00/405.95	c INFO: running hybridGM3@0 for 194 with 39594 remaining (b = 0.02)
3192.25/406.82	c INFO: running adaptg2wsat2009++@0 for 194 with 39593 remaining (b = 0.02)
3904.04/496.06	c INFO: running hybridGM3@101 for 97 with 39504 remaining (b = 0.01)
3936.61/500.15	c INFO: running hybridGM3@100 for 97 with 39500 remaining (b = 0.01)
3937.37/500.27	c INFO: running hybridGM3@0 for 194 with 39500 remaining (b = 0.02)
3958.85/502.98	c INFO: running TNM@0 for 97 with 39497 remaining (b = 0.01)
4711.27/597.37	c INFO: running hybridGM3@296 for 97 with 39403 remaining (b = 0.01)
4743.84/601.47	c INFO: running TNM@0 for 97 with 39399 remaining (b = 0.01)
4751.77/602.40	c INFO: running TNM@0 for 97 with 39398 remaining (b = 0.01)
4751.77/602.48	c INFO: running hybridGM3@94 for 97 with 39398 remaining (b = 0.01)
4753.17/602.69	c INFO: running hybridGM3@100 for 97 with 39397 remaining (b = 0.01)
4758.91/603.31	c INFO: running hybridGM3@0 for 194 with 39397 remaining (b = 0.02)
5470.49/692.68	c INFO: running hybridGM3@397 for 97 with 39307 remaining (b = 0.01)
5504.74/696.99	c INFO: running hybridGM3@98 for 97 with 39303 remaining (b = 0.01)
5511.89/697.80	c INFO: running TNM@0 for 97 with 39302 remaining (b = 0.01)
5543.82/701.82	c INFO: running TNM@0 for 97 with 39298 remaining (b = 0.01)
5550.04/702.74	c INFO: running TNM@0 for 97 with 39297 remaining (b = 0.01)
5561.29/704.03	c INFO: running TNM@0 for 97 with 39296 remaining (b = 0.01)
6229.75/788.03	c INFO: running hybridGM3@0 for 194 with 39212 remaining (b = 0.01)
6263.92/792.34	c INFO: running hybridGM3@193 for 97 with 39208 remaining (b = 0.01)
6302.12/797.18	c INFO: running TNM@0 for 97 with 39203 remaining (b = 0.01)
6341.86/802.18	c INFO: running TNM@0 for 97 with 39198 remaining (b = 0.01)
6342.57/802.29	c INFO: running adaptg2wsat2009++@0 for 194 with 39198 remaining (b = 0.01)
6360.05/804.41	c INFO: running TNM@0 for 97 with 39196 remaining (b = 0.01)
6372.75/806.10	c INFO: running hybridGM3@94 for 97 with 39194 remaining (b = 0.01)
7070.00/893.71	c INFO: running hybridGM3@292 for 194 with 39106 remaining (b = 0.01)
7100.27/897.59	c INFO: running TNM@0 for 97 with 39102 remaining (b = 0.01)
7139.94/902.57	c INFO: running TNM@0 for 97 with 39098 remaining (b = 0.01)
7150.23/903.86	c INFO: running TNM@0 for 97 with 39096 remaining (b = 0.01)
7178.89/907.47	c INFO: running hybridGM3@196 for 291 with 39093 remaining (b = 0.02)
7793.20/984.81	c INFO: running hybridGM3@95 for 97 with 39015 remaining (b = 0.01)
7882.25/996.05	c INFO: running TNM@0 for 97 with 39004 remaining (b = 0.01)
7886.40/996.69	c INFO: running TNM@0 for 97 with 39003 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321908-1304369340/watcher-3321908-1304369340 -o /tmp/evaluation-result-3321908-1304369340/solver-3321908-1304369340 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321908-1304369340.cnf -seed 491997586 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.60 8.19 6.32 2/303 25087
/proc/meminfo: memFree=21952432/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=15916 CPUtime=0 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 938 0 0 0 0 0 0 0 17 0 1 0 548531998 16297984 817 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244010017 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 3979 820 356 364 0 466 0

[startup+0.0646631 s]
/proc/loadavg: 7.60 8.19 6.32 2/303 25087
/proc/meminfo: memFree=21952432/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=47940 CPUtime=0.05 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 1931 0 0 0 4 1 0 0 17 0 1 0 548531998 49090560 1704 33554432000 4194304 5683644 140734505076432 18446744073709551615 228239378473 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 12517 1712 479 364 0 1204 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 47940

[startup+0.100653 s]
/proc/loadavg: 7.60 8.19 6.32 2/303 25087
/proc/meminfo: memFree=21952432/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=104224 CPUtime=0.07 cores=0-7
/proc/25087/stat : 25087 (python) S 25085 25087 23450 0 -1 4202496 3049 0 0 0 5 2 0 0 17 0 1 0 548531998 106725376 2733 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244346880 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/25087/statm: 26056 2733 847 364 0 1804 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104224

[startup+0.300622 s]
/proc/loadavg: 7.60 8.19 6.32 2/303 25087
/proc/meminfo: memFree=21952432/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=170756 CPUtime=0.24 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 6732 935 1 0 17 7 0 0 18 0 1 0 548531998 174854144 4805 33554432000 4194304 5683644 140734505076432 18446744073709551615 4957392 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 42689 4805 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 170756

[startup+0.700525 s]
/proc/loadavg: 7.60 8.19 6.32 2/303 25087
/proc/meminfo: memFree=21952432/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=295456 CPUtime=0.62 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 13451 935 1 0 51 11 0 0 18 0 1 0 548531998 302546944 11129 33554432000 4194304 5683644 140734505076432 18446744073709551615 46943452073504 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 73864 11130 1761 364 0 9788 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 295456

[startup+1.50037 s]
/proc/loadavg: 7.60 8.19 6.32 2/304 25092
/proc/meminfo: memFree=21896376/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=312976 CPUtime=1.42 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 21971 935 1 0 129 13 0 0 20 0 1 0 548531998 320487424 15628 33554432000 4194304 5683644 140734505076432 18446744073709551615 46943284102581 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 78244 15628 1826 364 0 14168 0
Current children cumulated CPU time (s) 1.42
Current children cumulated vsize (KiB) 312976

[startup+3.10109 s]
/proc/loadavg: 7.60 8.19 6.32 2/304 25092
/proc/meminfo: memFree=21896116/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=312976 CPUtime=3.02 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 21971 935 1 0 289 13 0 0 25 0 1 0 548531998 320487424 15628 33554432000 4194304 5683644 140734505076432 18446744073709551615 46943313883335 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 78244 15628 1826 364 0 14168 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 312976

[startup+6.30054 s]
/proc/loadavg: 7.15 8.09 6.30 2/304 25092
/proc/meminfo: memFree=21895512/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=312976 CPUtime=6.22 cores=0-7
/proc/25087/stat : 25087 (python) R 25085 25087 23450 0 -1 4202496 21978 935 1 0 609 13 0 0 25 0 1 0 548531998 320487424 15635 33554432000 4194304 5683644 140734505076432 18446744073709551615 46943313906002 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/25087/statm: 78244 15635 1833 364 0 14168 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 312976

[startup+12.7014 s]
/proc/loadavg: 7.22 8.09 6.31 9/328 25116
/proc/meminfo: memFree=21624960/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=457840 CPUtime=7.66 cores=0-7
/proc/25087/stat : 25087 (python) S 25085 25087 23450 0 -1 4202496 28150 935 1 0 751 15 0 0 19 0 9 0 548531998 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25087/statm: 114460 15204 1889 364 0 50357 0
[pid=25093] ppid=25087 vsize=310268 CPUtime=0.01 cores=0-7
/proc/25093/stat : 25093 (python) S 25087 25087 23450 0 -1 4202560 894 0 0 0 1 0 0 0 15 0 1 0 548532744 317714432 13495 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368911 0 0 16781312 514 3906701706980720898 0 0 17 7 0 0 0
/proc/25093/statm: 77567 13495 376 364 0 13485 0
[pid=25095] ppid=25093 vsize=268424 CPUtime=5.23 cores=0-7
/proc/25095/stat : 25095 (hybridGM3) R 25093 25095 25095 0 -1 4202496 8083 0 0 0 523 0 0 0 25 0 1 0 548532744 274866176 7818 33554432000 134512640 135204385 4288834464 18446744073709551615 134537272 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25095/statm: 67106 7818 64 169 0 66936 0
[pid=25096] ppid=25087 vsize=320524 CPUtime=0 cores=0-7
/proc/25096/stat : 25096 (python) S 25087 25087 23450 0 -1 4202560 893 0 0 0 0 0 0 0 15 0 1 0 548532747 328216576 13492 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 3906709403562115330 0 0 17 2 0 0 0
/proc/25096/statm: 80131 13492 369 364 0 16046 0
[pid=25098] ppid=25096 vsize=268428 CPUtime=5.2 cores=0-7
/proc/25098/stat : 25098 (hybridGM3) R 25096 25098 25098 0 -1 4202496 8087 0 0 0 519 1 0 0 25 0 1 0 548532748 274870272 7821 33554432000 134512640 135204385 4290381568 18446744073709551615 134537020 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25098/statm: 67107 7821 64 169 0 66937 0
[pid=25099] ppid=25087 vsize=330780 CPUtime=0.01 cores=0-7
/proc/25099/stat : 25099 (python) S 25087 25087 23450 0 -1 4202560 926 0 0 0 0 1 0 0 15 0 1 0 548532752 338718720 13497 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 3961101144276566276 0 0 17 1 0 0 0
/proc/25099/statm: 82695 13497 370 364 0 18607 0
[pid=25101] ppid=25099 vsize=268420 CPUtime=5.15 cores=0-7
/proc/25101/stat : 25101 (hybridGM3) R 25099 25101 25101 0 -1 4202496 8087 0 0 0 514 1 0 0 25 0 1 0 548532752 274862080 7823 33554432000 134512640 135204385 4291058944 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25101/statm: 67105 7823 64 169 0 66935 0
[pid=25102] ppid=25087 vsize=341036 CPUtime=0.01 cores=0-7
/proc/25102/stat : 25102 (python) S 25087 25087 23450 0 -1 4202560 944 0 0 0 0 1 0 0 15 0 1 0 548532756 349220864 13501 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 1076513422230651140 0 0 17 1 0 0 0
/proc/25102/statm: 85259 13501 370 364 0 21168 0
[pid=25104] ppid=25102 vsize=268420 CPUtime=5.11 cores=0-7
/proc/25104/stat : 25104 (hybridGM3) R 25102 25104 25104 0 -1 4202496 8082 0 0 0 510 1 0 0 25 0 1 0 548532756 274862080 7819 33554432000 134512640 135204385 4290100128 18446744073709551615 134537272 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25104/statm: 67105 7819 64 169 0 66935 0
[pid=25105] ppid=25087 vsize=416828 CPUtime=0.01 cores=0-7
/proc/25105/stat : 25105 (python) S 25087 25087 23450 0 -1 4202560 794 0 0 0 0 1 0 0 15 0 1 0 548532760 426831872 13679 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 3306034106680180995 0 0 17 1 0 0 0
/proc/25105/statm: 104207 13679 371 364 0 40113 0
[pid=25107] ppid=25105 vsize=268428 CPUtime=5.05 cores=0-7
/proc/25107/stat : 25107 (hybridGM3) R 25105 25107 25107 0 -1 4202496 8081 0 0 0 504 1 0 0 25 0 1 0 548532761 274870272 7826 33554432000 134512640 135204385 4289717840 18446744073709551615 134537401 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25107/statm: 67107 7826 64 169 0 66937 0
[pid=25108] ppid=25087 vsize=427084 CPUtime=0.01 cores=0-7
/proc/25108/stat : 25108 (python) S 25087 25087 23450 0 -1 4202560 809 0 0 0 0 1 0 0 15 0 1 0 548532764 437334016 13655 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 9388799337984655617 0 0 17 1 0 0 0
/proc/25108/statm: 106771 13655 371 364 0 42674 0
[pid=25110] ppid=25108 vsize=268424 CPUtime=4.95 cores=0-7
/proc/25110/stat : 25110 (hybridGM3) R 25108 25110 25110 0 -1 4202496 8076 0 0 0 494 1 0 0 25 0 1 0 548532765 274866176 7821 33554432000 134512640 135204385 4287266416 18446744073709551615 134537565 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25110/statm: 67106 7821 64 169 0 66936 0
[pid=25111] ppid=25087 vsize=437340 CPUtime=0 cores=0-7
/proc/25111/stat : 25111 (python) S 25087 25087 23450 0 -1 4202560 813 0 0 0 0 0 0 0 18 0 1 0 548532768 447836160 13660 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 10363482036269711620 0 0 17 1 0 0 0
/proc/25111/statm: 109335 13660 370 364 0 45235 0
[pid=25113] ppid=25111 vsize=465044 CPUtime=4.93 cores=0-7
/proc/25113/stat : 25113 (TNM) R 25111 25113 25113 0 -1 4202496 6008 0 0 0 493 0 0 0 25 0 1 0 548532770 476205056 5749 33554432000 134512640 135008748 4291687904 18446744073709551615 134527120 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25113/statm: 116261 5749 46 122 0 115161 0
[pid=25114] ppid=25087 vsize=447596 CPUtime=0 cores=0-7
/proc/25114/stat : 25114 (python) S 25087 25087 23450 0 -1 4202560 859 0 0 0 0 0 0 0 15 0 1 0 548532772 458338304 13688 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 10363478187979046911 0 0 17 1 0 0 0
/proc/25114/statm: 111899 13688 377 364 0 47796 0
[pid=25116] ppid=25114 vsize=268424 CPUtime=4.84 cores=0-7
/proc/25116/stat : 25116 (hybridGM3) R 25114 25116 25116 0 -1 4202496 8085 0 0 0 483 1 0 0 25 0 1 0 548532775 274866176 7822 33554432000 134512640 135204385 4292018048 18446744073709551615 134537290 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25116/statm: 67106 7822 64 169 0 66936 0
[pid=25087/tid=25094] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25094/stat : 25094 (python) S 25085 25087 23450 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 9 0 548532744 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25097] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25097/stat : 25097 (python) S 25085 25087 23450 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 9 0 548532748 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25100] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25100/stat : 25100 (python) S 25085 25087 23450 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 9 0 548532752 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 2 0 0 0
[pid=25087/tid=25103] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25103/stat : 25103 (python) S 25085 25087 23450 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 9 0 548532756 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 5 0 0 0
[pid=25087/tid=25106] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25106/stat : 25106 (python) S 25085 25087 23450 0 -1 4202560 93 935 0 0 0 0 0 0 21 0 9 0 548532760 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 2 0 0 0
[pid=25087/tid=25109] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25109/stat : 25109 (python) S 25085 25087 23450 0 -1 4202560 33 935 0 0 0 0 0 0 22 0 9 0 548532764 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 7 0 0 0
[pid=25087/tid=25112] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25112/stat : 25112 (python) S 25085 25087 23450 0 -1 4202560 32 935 0 0 0 0 0 0 19 0 9 0 548532769 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25115] ppid=25085 vsize=457840 CPUtime=0 cores=0-7
/proc/25087/task/25115/stat : 25115 (python) S 25085 25087 23450 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 9 0 548532773 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 48.17
Current children cumulated vsize (KiB) 5833308

[startup+25.5011 s]
/proc/loadavg: 7.39 8.08 6.33 9/328 25116
/proc/meminfo: memFree=21626264/32951124 swapFree=67111364/67111528
[pid=25087] ppid=25085 vsize=457840 CPUtime=7.66 cores=0-7
/proc/25087/stat : 25087 (python) S 25085 25087 23450 0 -1 4202496 28150 935 1 0 751 15 0 0 19 0 9 0 548531998 468828160 15204 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25087/statm: 114460 15204 1889 364 0 50357 0
[pid=25093] ppid=25087 vsize=310268 CPUtime=0.03 cores=0-7
/proc/25093/stat : 25093 (python) S 25087 25087 23450 0 -1 4202560 901 0 0 0 2 1 0 0 15 0 1 0 548532744 317714432 13495 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368911 0 0 16781312 514 15172820658657657090 0 0 17 7 0 0 0
/proc/25093/statm: 77567 13495 376 364 0 13485 0
[pid=25095] ppid=25093 vsize=268424 CPUtime=18.03 cores=0-7
/proc/25095/stat : 25095 (hybridGM3) R 25093 25095 25095 0 -1 4202496 8083 0 0 0 1803 0 0 0 25 0 1 0 548532744 274866176 7818 33554432000 134512640 135204385 4288834464 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25095/statm: 67106 7818 64 169 0 66936 0
[pid=25096] ppid=25087 vsize=320524 CPUtime=0.03 cores=0-7
/proc/25096/stat : 25096 (python) S 25087 25087 23450 0 -1 4202560 901 0 0 0 2 1 0 0 15 0 1 0 548532747 328216576 13493 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657090 0 0 17 2 0 0 0
/proc/25096/statm: 80131 13493 370 364 0 16046 0
[pid=25098] ppid=25096 vsize=268428 CPUtime=18 cores=0-7
/proc/25098/stat : 25098 (hybridGM3) R 25096 25098 25098 0 -1 4202496 8087 0 0 0 1799 1 0 0 25 0 1 0 548532748 274870272 7821 33554432000 134512640 135204385 4290381568 18446744073709551615 134537259 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25098/statm: 67107 7821 64 169 0 66937 0
[pid=25099] ppid=25087 vsize=330780 CPUtime=0.04 cores=0-7
/proc/25099/stat : 25099 (python) S 25087 25087 23450 0 -1 4202560 930 0 0 0 2 2 0 0 15 0 1 0 548532752 338718720 13497 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657092 0 0 17 1 0 0 0
/proc/25099/statm: 82695 13497 370 364 0 18607 0
[pid=25101] ppid=25099 vsize=268420 CPUtime=17.94 cores=0-7
/proc/25101/stat : 25101 (hybridGM3) R 25099 25101 25101 0 -1 4202496 8089 0 0 0 1793 1 0 0 25 0 1 0 548532752 274862080 7825 33554432000 134512640 135204385 4291058944 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25101/statm: 67105 7825 64 169 0 66935 0
[pid=25102] ppid=25087 vsize=341036 CPUtime=0.04 cores=0-7
/proc/25102/stat : 25102 (python) S 25087 25087 23450 0 -1 4202560 949 0 0 0 1 3 0 0 15 0 1 0 548532756 349220864 13501 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657092 0 0 17 1 0 0 0
/proc/25102/statm: 85259 13501 370 364 0 21168 0
[pid=25104] ppid=25102 vsize=268420 CPUtime=17.91 cores=0-7
/proc/25104/stat : 25104 (hybridGM3) R 25102 25104 25104 0 -1 4202496 8082 0 0 0 1790 1 0 0 25 0 1 0 548532756 274862080 7819 33554432000 134512640 135204385 4290100128 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25104/statm: 67105 7819 64 169 0 66935 0
[pid=25105] ppid=25087 vsize=416828 CPUtime=0.03 cores=0-7
/proc/25105/stat : 25105 (python) S 25087 25087 23450 0 -1 4202560 796 0 0 0 1 2 0 0 15 0 1 0 548532760 426831872 13679 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657091 0 0 17 1 0 0 0
/proc/25105/statm: 104207 13679 371 364 0 40113 0
[pid=25107] ppid=25105 vsize=268428 CPUtime=17.83 cores=0-7
/proc/25107/stat : 25107 (hybridGM3) R 25105 25107 25107 0 -1 4202496 8081 0 0 0 1782 1 0 0 25 0 1 0 548532761 274870272 7826 33554432000 134512640 135204385 4289717840 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25107/statm: 67107 7826 64 169 0 66937 0

################
# More data... #
################

/proc/25196/statm: 150359 14078 407 364 0 86211 0
[pid=25198] ppid=25196 vsize=465044 CPUtime=99.95 cores=0-7
/proc/25198/stat : 25198 (TNM) T 25196 25198 25198 0 -1 4202496 6033 0 0 0 9995 0 0 0 25 0 1 0 548602182 476205056 5748 33554432000 134512640 135008748 4287646992 18446744073709551615 134529475 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/25198/statm: 116261 5748 46 122 0 115161 0
[pid=25196/tid=25226] ppid=25087 vsize=601436 CPUtime=0 cores=0-7
/proc/25196/task/25226/stat : 25226 (python) S 25087 25087 23450 0 -1 4202560 82 0 0 0 0 0 0 0 19 0 2 0 548612208 615870464 14078 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604444058317824 0 0 -1 6 0 0 0
[pid=25200] ppid=25087 vsize=611692 CPUtime=0.27 cores=0-7
/proc/25200/stat : 25200 (python) S 25087 25087 23450 0 -1 4202560 1181 0 0 0 14 13 0 0 19 0 2 0 548602273 626372608 14046 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/25200/statm: 152923 14046 406 364 0 88772 0
[pid=25202] ppid=25200 vsize=465044 CPUtime=98.16 cores=0-7
/proc/25202/stat : 25202 (TNM) T 25200 25202 25202 0 -1 4202496 6033 0 0 0 9812 4 0 0 25 0 1 0 548602274 476205056 5748 33554432000 134512640 135008748 4288285488 18446744073709551615 134527693 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/25202/statm: 116261 5748 46 122 0 115161 0
[pid=25200/tid=25225] ppid=25087 vsize=611692 CPUtime=0 cores=0-7
/proc/25200/task/25225/stat : 25225 (python) S 25087 25087 23450 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 548612207 626372608 14046 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604451278344320 0 0 -1 2 0 0 0
[pid=25203] ppid=25087 vsize=621948 CPUtime=0.26 cores=0-7
/proc/25203/stat : 25203 (python) S 25087 25087 23450 0 -1 4202560 1165 0 0 0 13 13 0 0 19 0 2 0 548602402 636874752 14093 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/25203/statm: 155487 14093 400 364 0 91333 0
[pid=25205] ppid=25203 vsize=465044 CPUtime=99.71 cores=0-7
/proc/25205/stat : 25205 (TNM) T 25203 25205 25205 0 -1 4202496 6032 0 0 0 9970 1 0 0 25 0 1 0 548602402 476205056 5748 33554432000 134512640 135008748 4288343168 18446744073709551615 134529183 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/25205/statm: 116261 5748 46 122 0 115161 0
[pid=25203/tid=25233] ppid=25087 vsize=621948 CPUtime=0 cores=0-7
/proc/25203/task/25233/stat : 25233 (python) S 25087 25087 23450 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548612428 636874752 14093 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604451278346112 0 0 -1 0 0 0 0
[pid=25218] ppid=25087 vsize=632204 CPUtime=0.56 cores=0-7
/proc/25218/stat : 25218 (python) S 25087 25087 23450 0 -1 4202560 1180 0 0 0 27 29 0 0 15 0 2 0 548610802 647376896 14059 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/25218/statm: 158051 14059 400 364 0 93894 0
[pid=25220] ppid=25218 vsize=268424 CPUtime=208.23 cores=0-7
/proc/25220/stat : 25220 (hybridGM3) R 25218 25220 25220 0 -1 4202496 8103 0 0 0 20822 1 0 0 25 0 1 0 548610802 274866176 7822 33554432000 134512640 135204385 4292059600 18446744073709551615 134537608 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25220/statm: 67106 7822 64 169 0 66936 0
[pid=25218/tid=25258] ppid=25087 vsize=632204 CPUtime=0 cores=0-7
/proc/25218/task/25258/stat : 25258 (python) S 25087 25087 23450 0 -1 4202560 86 0 0 0 0 0 0 0 17 0 2 0 548630468 647376896 14059 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604444041073856 0 0 -1 5 0 0 0
[pid=25222] ppid=25087 vsize=642460 CPUtime=0.26 cores=0-7
/proc/25222/stat : 25222 (python) S 25087 25087 23450 0 -1 4202560 1188 0 0 0 12 14 0 0 19 0 2 0 548611717 657879040 14039 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25222/statm: 160615 14039 400 364 0 96455 0
[pid=25224] ppid=25222 vsize=465044 CPUtime=100.18 cores=0-7
/proc/25224/stat : 25224 (TNM) T 25222 25224 25224 0 -1 4202496 6034 0 0 0 10017 1 0 0 25 0 1 0 548611717 476205056 5749 33554432000 134512640 135008748 4294386048 18446744073709551615 134527475 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/25224/statm: 116261 5749 46 122 0 115161 0
[pid=25222/tid=25241] ppid=25087 vsize=642460 CPUtime=0 cores=0-7
/proc/25222/task/25241/stat : 25241 (python) S 25087 25087 23450 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548621746 657879040 14039 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604453438122176 0 0 -1 6 0 0 0
[pid=25227] ppid=25087 vsize=652716 CPUtime=0.27 cores=0-7
/proc/25227/stat : 25227 (python) S 25087 25087 23450 0 -1 4202560 1195 0 0 0 14 13 0 0 19 0 2 0 548612217 668381184 14130 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/25227/statm: 163179 14130 401 364 0 99016 0
[pid=25229] ppid=25227 vsize=465044 CPUtime=99.14 cores=0-7
/proc/25229/stat : 25229 (TNM) T 25227 25229 25229 0 -1 4202496 6033 0 0 0 9911 3 0 0 25 0 1 0 548612217 476205056 5748 33554432000 134512640 135008748 4294297680 18446744073709551615 134528967 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/25229/statm: 116261 5748 46 122 0 115161 0
[pid=25227/tid=25245] ppid=25087 vsize=652716 CPUtime=0 cores=0-7
/proc/25227/task/25245/stat : 25245 (python) S 25087 25087 23450 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548622244 668381184 14130 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604453822294016 0 0 -1 1 0 0 0
[pid=25230] ppid=25087 vsize=662972 CPUtime=0.51 cores=0-7
/proc/25230/stat : 25230 (python) S 25087 25087 23450 0 -1 4202560 1031 0 0 0 26 25 0 0 18 0 1 0 548612227 678883328 14065 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657091 0 0 17 2 0 0 0
/proc/25230/statm: 165743 14065 378 364 0 101577 0
[pid=25232] ppid=25230 vsize=431704 CPUtime=193.19 cores=0-7
/proc/25232/stat : 25232 (adaptg2wsat2009) R 25230 25232 25232 0 -1 4202496 6276 0 0 0 19318 1 0 0 25 0 1 0 548612228 442064896 5984 33554432000 134512640 135107411 4290744000 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25232/statm: 107926 5984 59 146 0 106802 0
[pid=25234] ppid=25087 vsize=673228 CPUtime=0.27 cores=0-7
/proc/25234/stat : 25234 (python) S 25087 25087 23450 0 -1 4202560 1229 0 0 0 14 13 0 0 19 0 2 0 548612440 689385472 14157 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25234/statm: 168307 14157 407 364 0 104138 0
[pid=25236] ppid=25234 vsize=465044 CPUtime=98.51 cores=0-7
/proc/25236/stat : 25236 (TNM) T 25234 25236 25236 0 -1 4202496 6037 0 0 0 9850 1 0 0 25 0 1 0 548612440 476205056 5748 33554432000 134512640 135008748 4294434032 18446744073709551615 134529448 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/25236/statm: 116261 5748 46 122 0 115161 0
[pid=25234/tid=25249] ppid=25087 vsize=673228 CPUtime=0 cores=0-7
/proc/25234/task/25249/stat : 25249 (python) S 25087 25087 23450 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 548622373 689385472 14157 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604448071963776 0 0 -1 6 0 0 0
[pid=25242] ppid=25087 vsize=683484 CPUtime=0.28 cores=0-7
/proc/25242/stat : 25242 (python) S 25087 25087 23450 0 -1 4202560 1241 0 0 0 15 13 0 0 19 0 2 0 548621757 699887616 14084 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25242/statm: 170871 14084 407 364 0 106699 0
[pid=25244] ppid=25242 vsize=465044 CPUtime=97.58 cores=0-7
/proc/25244/stat : 25244 (TNM) T 25242 25244 25244 0 -1 4202496 6042 0 0 0 9753 5 0 0 25 0 1 0 548621758 476205056 5749 33554432000 134512640 135008748 4290461792 18446744073709551615 134527693 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/25244/statm: 116261 5749 46 122 0 115161 0
[pid=25242/tid=25259] ppid=25087 vsize=683484 CPUtime=0 cores=0-7
/proc/25242/task/25259/stat : 25259 (python) S 25087 25087 23450 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 548631590 699887616 14084 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 514 18446604448071962880 0 0 -1 2 0 0 0
[pid=25246] ppid=25087 vsize=693740 CPUtime=0.26 cores=0-7
/proc/25246/stat : 25246 (python) S 25087 25087 23450 0 -1 4202560 1057 0 0 0 14 12 0 0 18 0 1 0 548622255 710389760 14152 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657089 0 0 17 6 0 0 0
/proc/25246/statm: 173435 14152 378 364 0 109260 0
[pid=25248] ppid=25246 vsize=465044 CPUtime=93.4 cores=0-7
/proc/25248/stat : 25248 (TNM) R 25246 25248 25248 0 -1 4202496 6042 0 0 0 9339 1 0 0 25 0 1 0 548622260 476205056 5749 33554432000 134512640 135008748 4289061936 18446744073709551615 134529422 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25248/statm: 116261 5749 46 122 0 115161 0
[pid=25250] ppid=25087 vsize=703996 CPUtime=0.25 cores=0-7
/proc/25250/stat : 25250 (python) S 25087 25087 23450 0 -1 4202560 1040 0 0 0 13 12 0 0 18 0 1 0 548622385 720891904 14073 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 15172820658657657091 0 0 17 1 0 0 0
/proc/25250/statm: 175999 14073 372 364 0 111821 0
[pid=25252] ppid=25250 vsize=465044 CPUtime=88.05 cores=0-7
/proc/25252/stat : 25252 (TNM) R 25250 25252 25252 0 -1 4202496 6041 0 0 0 8804 1 0 0 25 0 1 0 548622385 476205056 5749 33554432000 134512640 135008748 4294362688 18446744073709551615 134529183 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25252/statm: 116261 5749 46 122 0 115161 0
[pid=25260] ppid=25087 vsize=714252 CPUtime=0 cores=0-7
/proc/25260/stat : 25260 (python) S 25087 25087 23450 0 -1 4202560 922 0 0 0 0 0 0 0 19 0 1 0 548631603 731394048 14099 33554432000 4194304 5683644 140734505076432 18446744073709551615 228244368966 0 0 16781312 514 6435244474208616447 0 0 17 1 0 0 0
/proc/25260/statm: 178563 14099 346 364 0 114382 0
[pid=25262] ppid=25260 vsize=462008 CPUtime=0.46 cores=0-7
/proc/25262/stat : 25262 (TNM) R 25260 25262 25262 0 -1 4202496 3981 0 0 0 46 0 0 0 21 0 1 0 548631604 473096192 3694 33554432000 134512640 135008748 4293084672 18446744073709551615 134580187 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25262/statm: 115502 3694 46 122 0 114402 0
[pid=25087/tid=25094] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25094/stat : 25094 (python) S 25085 25087 23450 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 35 0 548532744 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25097] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25097/stat : 25097 (python) S 25085 25087 23450 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 35 0 548532748 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25100] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25100/stat : 25100 (python) S 25085 25087 23450 0 -1 4202560 41 935 0 0 0 0 0 0 18 0 35 0 548532752 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 2 0 0 0
[pid=25087/tid=25103] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25103/stat : 25103 (python) S 25085 25087 23450 0 -1 4202560 42 935 0 0 0 0 0 0 15 0 35 0 548532756 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 5 0 0 0
[pid=25087/tid=25106] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25106/stat : 25106 (python) S 25085 25087 23450 0 -1 4202560 99 935 0 0 0 0 0 0 18 0 35 0 548532760 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 2 0 0 0
[pid=25087/tid=25109] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25109/stat : 25109 (python) S 25085 25087 23450 0 -1 4202560 43 935 0 0 0 0 0 0 18 0 35 0 548532764 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 7 0 0 0
[pid=25087/tid=25112] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25112/stat : 25112 (python) S 25085 25087 23450 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 35 0 548532769 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 4 0 0 0
[pid=25087/tid=25115] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25115/stat : 25115 (python) S 25085 25087 23450 0 -1 4202560 50 935 0 0 0 0 0 0 18 0 35 0 548532773 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25125] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25125/stat : 25125 (python) S 25085 25087 23450 0 -1 4202560 48 935 0 0 0 0 0 0 18 0 35 0 548542802 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25137] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25137/stat : 25137 (python) S 25085 25087 23450 0 -1 4202560 63 935 0 0 0 0 0 0 18 0 35 0 548561938 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25140] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25140/stat : 25140 (python) S 25085 25087 23450 0 -1 4202560 32 935 0 0 0 0 0 0 19 0 35 0 548562432 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25143] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25143/stat : 25143 (python) S 25085 25087 23450 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 35 0 548562438 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25149] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25149/stat : 25149 (python) S 25085 25087 23450 0 -1 4202560 59 935 0 0 0 0 0 0 18 0 35 0 548571972 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25152] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25152/stat : 25152 (python) S 25085 25087 23450 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 35 0 548572088 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25156] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25156/stat : 25156 (python) S 25085 25087 23450 0 -1 4202560 43 935 0 0 0 0 0 0 18 0 35 0 548572595 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25159] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25159/stat : 25159 (python) S 25085 25087 23450 0 -1 4202560 86 935 0 0 0 0 0 0 20 0 35 0 548572681 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25168] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25168/stat : 25168 (python) S 25085 25087 23450 0 -1 4202560 56 935 0 0 0 0 0 0 18 0 35 0 548582026 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25171] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25171/stat : 25171 (python) S 25085 25087 23450 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 35 0 548582297 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25177] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25177/stat : 25177 (python) S 25085 25087 23450 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 35 0 548592146 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25182] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25182/stat : 25182 (python) S 25085 25087 23450 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 35 0 548592239 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25187] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25187/stat : 25187 (python) S 25085 25087 23450 0 -1 4202560 46 935 0 0 0 0 0 0 18 0 35 0 548592330 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25193] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25193/stat : 25193 (python) S 25085 25087 23450 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 35 0 548601779 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25197] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25197/stat : 25197 (python) S 25085 25087 23450 0 -1 4202560 31 935 0 0 0 0 0 0 19 0 35 0 548602181 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25201] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25201/stat : 25201 (python) S 25085 25087 23450 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 35 0 548602274 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25204] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25204/stat : 25204 (python) S 25085 25087 23450 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 35 0 548602402 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 1 0 0 0
[pid=25087/tid=25219] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25219/stat : 25219 (python) S 25085 25087 23450 0 -1 4202560 41 935 0 0 0 0 0 0 18 0 35 0 548610802 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25223] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25223/stat : 25223 (python) S 25085 25087 23450 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 35 0 548611717 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25228] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25228/stat : 25228 (python) S 25085 25087 23450 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 35 0 548612217 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 0 0 0 0
[pid=25087/tid=25231] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25231/stat : 25231 (python) S 25085 25087 23450 0 -1 4202560 34 935 0 0 0 0 0 0 22 0 35 0 548612228 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25235] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25235/stat : 25235 (python) S 25085 25087 23450 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 35 0 548612440 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25243] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25243/stat : 25243 (python) S 25085 25087 23450 0 -1 4202560 36 935 0 0 0 0 0 0 19 0 35 0 548621758 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25247] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25247/stat : 25247 (python) S 25085 25087 23450 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 35 0 548622256 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25251] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25251/stat : 25251 (python) S 25085 25087 23450 0 -1 4202560 33 935 0 0 0 0 0 0 19 0 35 0 548622385 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
[pid=25087/tid=25261] ppid=25085 vsize=724496 CPUtime=0 cores=0-7
/proc/25087/task/25261/stat : 25261 (python) S 25085 25087 23450 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 35 0 548631604 741883904 15699 33554432000 4194304 5683644 140734505076432 18446744073709551615 228256172465 0 0 16781312 2 18446604453639625664 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7886.4
Current children cumulated vsize (KiB) 31796012

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25087 and gives
#  childrusage.ru_utime.tv_sec=1709
#  childrusage.ru_utime.tv_usec=681088
#  childrusage.ru_stime.tv_sec=10
#  childrusage.ru_stime.tv_usec=119461
# CPU time returned by wait4() is 1719.8
# while last known CPU time is 7886.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 996.717
CPU time (s): 7886.4
CPU user time (s): 7875.55
CPU system time (s): 10.85
CPU usage (%): 791.238
Max. virtual memory (cumulated for all children) (KiB): 31796012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1709.68
system time used= 10.1195
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 145236
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10255
involuntary context switches= 6373

runsolver used 8.68968 second user time and 21.5817 second system time

The end

Launcher Data 

Begin job on node136 at 2011-05-02 22:49:00
IDJOB=3321908
IDBENCH=82686
IDSOLVER=1712
FILE ID=node136/3321908-1304369340
RUNJOBID= node136-1304347125-23464
PBS_JOBID= 13178655
Free space on /tmp= 73884 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S625465881-078-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321908-1304369340/watcher-3321908-1304369340 -o /tmp/evaluation-result-3321908-1304369340/solver-3321908-1304369340 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321908-1304369340.cnf -seed 491997586 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3ba69e7f651721ce4358ca0320f27486
RANDOM SEED=491997586

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21952588 kB
Buffers:        677888 kB
Cached:        1595612 kB
SwapCached:          0 kB
Active:        8703652 kB
Inactive:      1822912 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21952588 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           35060 kB
Writeback:           0 kB
AnonPages:     8253832 kB
Mapped:          26780 kB
Slab:           373836 kB
PageTables:      33044 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 59767920 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73852 MiB
End job on node136 at 2011-05-02 23:05:39