Trace number 3385767

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 17958.2 2257.32

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v90-c8010-S741717046-057.UNKNOWN.cnf
MD5SUM1f00de1fd8adbfbf4cc573ef44af531f
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables90
Number of clauses8010
Sum of the clauses size56070
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58010

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3385767-1305573404.cnf
0.32/0.47	c INFO: computing task features
0.41/0.52	c INFO: computed variable-clause graph statistics
0.41/0.52	c INFO: computed clause balance statistics
0.71/0.81	c INFO: computed variable balance statistics
0.81/0.93	c INFO: computed small-clause counts
0.81/0.93	c INFO: computed Horn-clause counts
0.81/0.94	c INFO: computed variable graph statistics
0.81/0.94	c INFO: collected features for HOME/instance-3385767-1305573404.cnf in 0.47 s
0.81/0.97	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.47)
0.81/1.00	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.11)
0.93/1.03	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.06)
0.93/1.05	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.05)
0.93/1.08	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.04)
1.16/1.11	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.03)
1.16/1.15	c INFO: running FH@0 for 97 with 4999 remaining (b = 0.03)
1.16/1.18	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.02)
801.20/101.34	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.02)
801.20/101.39	c INFO: running FH@0 for 97 with 4899 remaining (b = 0.02)
801.91/101.43	c INFO: running hybridGM3@0 for 194 with 4899 remaining (b = 0.03)
801.91/101.47	c INFO: running gnovelty+2@0 for 97 with 4899 remaining (b = 0.01)
802.35/101.51	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.02)
802.35/101.55	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.01)
802.35/101.59	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.01)
802.54/101.63	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.01)
1562.52/196.90	c INFO: running adaptg2wsat2009++@98 for 97 with 4803 remaining (b = 0.01)
1563.42/196.94	c INFO: running hybridGM3@0 for 194 with 4803 remaining (b = 0.02)
1563.42/196.98	c INFO: running march_hi@0 for 388 with 4803 remaining (b = 0.04)
1601.55/201.72	c INFO: running hybridGM3@0 for 194 with 4798 remaining (b = 0.02)
1601.55/201.77	c INFO: running TNM@0 for 1552 with 4798 remaining (b = 0.14)
1602.23/201.87	c INFO: running FH@0 for 97 with 4798 remaining (b = 0.01)
2369.61/298.15	c INFO: running hybridGM3@100 for 97 with 4702 remaining (b = 0.01)
2370.27/298.23	c INFO: running hybridGM3@99 for 97 with 4702 remaining (b = 0.01)
2387.11/300.32	c INFO: running adaptg2wsat2009++@100 for 97 with 4700 remaining (b = 0.01)
2402.11/302.25	c INFO: running march_hi@0 for 388 with 4698 remaining (b = 0.04)
3129.36/393.52	c INFO: running hybridGM3@295 for 97 with 4606 remaining (b = 0.01)
3161.22/397.50	c INFO: running hybridGM3@100 for 97 with 4603 remaining (b = 0.01)
3171.57/398.87	c INFO: running hybridGM3@95 for 97 with 4601 remaining (b = 0.01)
3177.89/399.62	c INFO: running adaptg2wsat2009++@98 for 97 with 4600 remaining (b = 0.01)
3210.66/403.73	c INFO: running gnovelty+2@0 for 97 with 4596 remaining (b = 0.01)
3936.16/494.91	c INFO: running hybridGM3@0 for 194 with 4505 remaining (b = 0.02)
3953.68/497.02	c INFO: running march_hi@0 for 388 with 4503 remaining (b = 0.03)
3967.99/498.90	c INFO: running hybridGM3@297 for 97 with 4501 remaining (b = 0.01)
3979.92/500.32	c INFO: running hybridGM3@0 for 194 with 4500 remaining (b = 0.01)
4010.17/504.17	c INFO: running TNM@0 for 1552 with 4496 remaining (b = 0.11)
4672.06/587.22	c INFO: running march_hi@100 for 291 with 4413 remaining (b = 0.03)
4727.80/594.27	c INFO: running hybridGM3@395 for 97 with 4406 remaining (b = 0.01)
5503.61/691.66	c INFO: running hybridGM3@97 for 97 with 4308 remaining (b = 0.01)
5518.75/693.54	c INFO: running FH@196 for 194 with 4306 remaining (b = 0.01)
5535.43/695.67	c INFO: running iPAWS@0 for 97 with 4304 remaining (b = 0.01)
5546.59/697.10	c INFO: running march_hi@95 for 291 with 4303 remaining (b = 0.03)
6311.10/793.06	c INFO: running hybridGM3@99 for 97 with 4207 remaining (b = 0.01)
6334.98/796.08	c INFO: running adaptg2wsat2009++@94 for 97 with 4204 remaining (b = 0.01)
7061.18/887.26	c INFO: running FH@296 for 97 with 4113 remaining (b = 0.01)
7069.14/888.24	c INFO: running adaptg2wsat2009++@100 for 97 with 4112 remaining (b = 0.01)
7083.55/890.06	c INFO: running adaptg2wsat2009++@193 for 97 with 4110 remaining (b = 0.01)
7086.63/890.46	c INFO: running march_hi@101 for 2037 with 4110 remaining (b = 0.14)
7110.49/893.49	c INFO: running march_hi@192 for 388 with 4107 remaining (b = 0.04)
7844.71/985.64	c INFO: running adaptg2wsat2009++@391 for 194 with 4014 remaining (b = 0.01)
7858.92/987.46	c INFO: running iPAWS@0 for 97 with 4013 remaining (b = 0.01)
7860.37/987.71	c INFO: running FH@0 for 97 with 4012 remaining (b = 0.01)
7887.55/991.12	c INFO: running march_hi@194 for 1940 with 4009 remaining (b = 0.14)
8657.62/1087.87	c INFO: running march_hi@0 for 485 with 3912 remaining (b = 0.04)
8659.77/1088.13	c INFO: running march_hi@0 for 388 with 3912 remaining (b = 0.03)
9369.58/1177.35	c INFO: running FH@293 for 97 with 3823 remaining (b = 0.01)
10144.39/1274.80	c INFO: running adaptg2wsat2009++@487 for 97 with 3725 remaining (b = 0.01)
10258.95/1289.19	c INFO: running march_hi@289 for 194 with 3711 remaining (b = 0.02)
10967.01/1378.23	c INFO: running adaptg2wsat2009++@874 for 97 with 3622 remaining (b = 0.01)
11725.94/1473.61	c INFO: running adaptg2wsat2009++@968 for 97 with 3526 remaining (b = 0.01)
11768.08/1478.95	c INFO: running march_hi@190 for 291 with 3521 remaining (b = 0.03)
11837.38/1487.67	c INFO: running march_hi@392 for 1746 with 3512 remaining (b = 0.11)
12476.88/1568.01	c INFO: running march_hi@0 for 388 with 3432 remaining (b = 0.03)
12557.23/1578.12	c INFO: running march_hi@100 for 291 with 3422 remaining (b = 0.03)
14060.77/1767.18	c INFO: running march_hi@0 for 388 with 3233 remaining (b = 0.03)
14129.11/1775.77	c INFO: running march_hi@387 for 97 with 3224 remaining (b = 0.01)
14885.64/1870.83	c INFO: running march_hi@481 for 97 with 3129 remaining (b = 0.01)
14898.35/1872.41	c INFO: running march_hi@1658 for 485 with 3128 remaining (b = 0.07)
15595.21/1960.09	c INFO: running hybridGM3@0 for 194 with 3040 remaining (b = 0.01)
15668.38/1969.27	c INFO: running march_hi@0 for 388 with 3031 remaining (b = 0.03)
16427.20/2064.64	c INFO: running TNM@389 for 1067 with 2935 remaining (b = 0.07)
17160.51/2156.86	c INFO: running hybridGM3@97 for 97 with 2843 remaining (b = 0.01)
17161.30/2156.99	c INFO: running march_hi@295 for 97 with 2843 remaining (b = 0.01)
17950.25/2256.13	c INFO: running gnovelty+2@0 for 97 with 2744 remaining (b = 0.01)
17958.22/2257.30	c INFO: running hybridGM3@0 for 194 with 2743 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385767-1305573404/watcher-3385767-1305573404 -o /tmp/evaluation-result-3385767-1305573404/solver-3385767-1305573404 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385767-1305573404.cnf -seed 60023278 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.51 8.33 8.35 1/445 957
/proc/meminfo: memFree=12234024/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=15080 CPUtime=0 cores=0-7
/proc/957/stat : 957 (python) R 955 957 800 0 -1 4202496 648 0 0 0 0 0 0 0 18 0 1 0 747571093 15441920 544 33554432000 4194304 5683644 140737265215104 18446744073709551615 4297424 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/957/statm: 3770 545 312 364 0 257 0

[startup+0.096757 s]
/proc/loadavg: 7.51 8.33 8.35 1/445 957
/proc/meminfo: memFree=12234024/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=102016 CPUtime=0.06 cores=0-7
/proc/957/stat : 957 (python) R 955 957 800 0 -1 4202496 3008 0 0 0 5 1 0 0 17 0 1 0 747571093 104464384 2701 33554432000 4194304 5683644 140737265215104 18446744073709551615 4509116 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/957/statm: 25504 2702 841 364 0 1804 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 102016

[startup+0.100807 s]
/proc/loadavg: 7.51 8.33 8.35 1/445 957
/proc/meminfo: memFree=12234024/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=104232 CPUtime=0.07 cores=0-7
/proc/957/stat : 957 (python) R 955 957 800 0 -1 4202496 3064 0 0 0 5 2 0 0 17 0 1 0 747571093 106733568 2747 33554432000 4194304 5683644 140737265215104 18446744073709551615 4990038 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/957/statm: 26057 2746 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.300742 s]
/proc/loadavg: 7.51 8.33 8.35 1/445 957
/proc/meminfo: memFree=12234024/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=170756 CPUtime=0.24 cores=0-7
/proc/957/stat : 957 (python) S 955 957 800 0 -1 4202496 6740 936 1 0 18 6 0 0 17 0 1 0 747571093 174854144 4809 33554432000 4194304 5683644 140737265215104 18446744073709551615 216730254983 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/957/statm: 42689 4809 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 170756

[startup+0.700647 s]
/proc/loadavg: 7.51 8.33 8.35 1/445 957
/proc/meminfo: memFree=12234024/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=280236 CPUtime=0.61 cores=0-7
/proc/957/stat : 957 (python) R 955 957 800 0 -1 4202496 9992 936 1 0 52 9 0 0 18 0 1 0 747571093 286961664 7443 33554432000 4194304 5683644 140737265215104 18446744073709551615 4563019 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/957/statm: 70059 7443 1826 364 0 5983 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 280236

[startup+1.50046 s]
/proc/loadavg: 7.51 8.33 8.35 3/449 965
/proc/meminfo: memFree=12206960/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=427308 CPUtime=1.09 cores=0-7
/proc/957/stat : 957 (python) S 955 957 800 0 -1 4202496 16160 936 1 0 99 10 0 0 20 0 9 0 747571093 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/957/statm: 106827 7563 1891 364 0 42724 0
[pid=963] ppid=957 vsize=279416 CPUtime=0 cores=0-7
/proc/963/stat : 963 (python) S 957 957 800 0 -1 4202560 733 0 0 0 0 0 0 0 19 0 1 0 747571190 286121984 5792 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198735 0 0 16781312 514 7242440765257809919 0 0 17 1 0 0 0
/proc/963/statm: 69854 5792 354 364 0 5772 0
[pid=965] ppid=963 vsize=1018088 CPUtime=0.52 cores=0-7
/proc/965/stat : 965 (gnovelty+2) R 963 965 965 0 -1 4202496 571 0 0 0 52 0 0 0 22 0 1 0 747571191 1042522112 306 33554432000 134512640 135663704 4286964608 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/965/statm: 254522 306 113 282 0 254238 0
[pid=957/tid=964] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/964/stat : 964 (python) S 955 957 800 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 9 0 747571190 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 6 0 0 0
[pid=957/tid=967] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/967/stat : 967 (python) S 955 957 800 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 9 0 747571193 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.61
Current children cumulated vsize (KiB) 1724812

[startup+3.10119 s]
/proc/loadavg: 7.51 8.33 8.35 9/470 987
/proc/meminfo: memFree=12170336/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=427308 CPUtime=1.09 cores=0-7
/proc/957/stat : 957 (python) S 955 957 800 0 -1 4202496 16160 936 1 0 99 10 0 0 20 0 9 0 747571093 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/957/statm: 106827 7563 1891 364 0 42724 0
[pid=963] ppid=957 vsize=279416 CPUtime=0 cores=0-7
/proc/963/stat : 963 (python) S 957 957 800 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 747571190 286121984 5792 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198735 0 0 16781312 514 7242440765257777409 0 0 17 1 0 0 0
/proc/963/statm: 69854 5792 354 364 0 5772 0
[pid=965] ppid=963 vsize=1018088 CPUtime=2.1 cores=0-7
/proc/965/stat : 965 (gnovelty+2) R 963 965 965 0 -1 4202496 571 0 0 0 210 0 0 0 25 0 1 0 747571191 1042522112 306 33554432000 134512640 135663704 4286964608 18446744073709551615 134546906 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/965/statm: 254522 306 113 282 0 254238 0
[pid=966] ppid=957 vsize=289992 CPUtime=0 cores=0-7
/proc/966/stat : 966 (python) S 957 957 800 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 747571193 296951808 5838 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 16025655482647544067 0 0 17 1 0 0 0
/proc/966/statm: 72498 5838 348 364 0 8413 0
[pid=968] ppid=966 vsize=1018088 CPUtime=2.09 cores=0-7
/proc/968/stat : 968 (gnovelty+2) R 966 968 968 0 -1 4202496 573 0 0 0 209 0 0 0 25 0 1 0 747571193 1042522112 307 33554432000 134512640 135663704 4294501712 18446744073709551615 134546746 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/968/statm: 254522 307 113 282 0 254238 0
[pid=969] ppid=957 vsize=300248 CPUtime=0 cores=0-7
/proc/969/stat : 969 (python) S 957 957 800 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 747571196 307453952 5842 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 4205847759695085827 0 0 17 1 0 0 0
/proc/969/statm: 75062 5842 348 364 0 10974 0
[pid=971] ppid=969 vsize=417192 CPUtime=2.05 cores=0-7
/proc/971/stat : 971 (adaptg2wsat2009) R 969 971 971 0 -1 4202496 761 0 0 0 205 0 0 0 25 0 1 0 747571196 427204608 496 33554432000 134512640 135107411 4288177936 18446744073709551615 134531928 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/971/statm: 104298 496 59 146 0 103174 0
[pid=972] ppid=957 vsize=310504 CPUtime=0 cores=0-7
/proc/972/stat : 972 (python) S 957 957 800 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 747571199 317956096 5846 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 4249498371317793025 0 0 17 5 0 0 0
/proc/972/statm: 77626 5846 348 364 0 13535 0
[pid=974] ppid=972 vsize=417192 CPUtime=2.03 cores=0-7
/proc/974/stat : 974 (adaptg2wsat2009) R 972 974 974 0 -1 4202496 761 0 0 0 203 0 0 0 25 0 1 0 747571199 427204608 495 33554432000 134512640 135107411 4287977856 18446744073709551615 134532349 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/974/statm: 104298 495 59 146 0 103174 0
[pid=975] ppid=957 vsize=386296 CPUtime=0 cores=0-7
/proc/975/stat : 975 (python) S 957 957 800 0 -1 4202560 720 0 0 0 0 0 0 0 18 0 1 0 747571202 395567104 6023 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 648597240595579138 0 0 17 1 0 0 0
/proc/975/statm: 96574 6023 348 364 0 32480 0
[pid=978] ppid=975 vsize=417192 CPUtime=1.99 cores=0-7
/proc/978/stat : 978 (adaptg2wsat2009) R 975 978 978 0 -1 4202496 753 0 0 0 199 0 0 0 25 0 1 0 747571202 427204608 494 33554432000 134512640 135107411 4287000160 18446744073709551615 134531741 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/978/statm: 104298 494 59 146 0 103174 0
[pid=979] ppid=957 vsize=396552 CPUtime=0 cores=0-7
/proc/979/stat : 979 (python) S 957 957 800 0 -1 4202560 728 0 0 0 0 0 0 0 18 0 1 0 747571205 406069248 5991 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 9434187177979248899 0 0 17 1 0 0 0
/proc/979/statm: 99138 5991 348 364 0 35041 0
[pid=981] ppid=979 vsize=1018088 CPUtime=1.97 cores=0-7
/proc/981/stat : 981 (gnovelty+2) R 979 981 981 0 -1 4202496 563 0 0 0 197 0 0 0 25 0 1 0 747571205 1042522112 307 33554432000 134512640 135663704 4287251056 18446744073709551615 134525009 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/981/statm: 254522 307 113 282 0 254238 0
[pid=982] ppid=957 vsize=406808 CPUtime=0 cores=0-7
/proc/982/stat : 982 (python) S 957 957 800 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 747571208 416571392 5995 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 2740717454480113663 0 0 17 1 0 0 0
/proc/982/statm: 101702 5995 348 364 0 37602 0
[pid=984] ppid=982 vsize=247344 CPUtime=1.92 cores=0-7
/proc/984/stat : 984 (FH) R 982 984 984 0 -1 4202496 701 0 0 0 192 0 0 0 25 0 1 0 747571210 253280256 443 33554432000 134512640 134936988 4288128240 18446744073709551615 134545184 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/984/statm: 61836 443 41 104 0 61340 0
[pid=985] ppid=957 vsize=417064 CPUtime=0 cores=0-7
/proc/985/stat : 985 (python) S 957 957 800 0 -1 4202560 775 0 0 0 0 0 0 0 18 0 1 0 747571211 427073536 6022 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 5412855890539708415 0 0 17 1 0 0 0
/proc/985/statm: 104266 6022 354 364 0 40163 0
[pid=987] ppid=985 vsize=417192 CPUtime=1.91 cores=0-7
/proc/987/stat : 987 (adaptg2wsat2009) R 985 987 987 0 -1 4202496 760 0 0 0 191 0 0 0 25 0 1 0 747571211 427204608 494 33554432000 134512640 135107411 4292471792 18446744073709551615 134531731 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/987/statm: 104298 494 59 146 0 103174 0
[pid=957/tid=964] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/964/stat : 964 (python) S 955 957 800 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 9 0 747571190 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 6 0 0 0
[pid=957/tid=967] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/967/stat : 967 (python) S 955 957 800 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 9 0 747571193 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=970] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/970/stat : 970 (python) S 955 957 800 0 -1 4202560 25 936 0 0 0 0 0 0 19 0 9 0 747571196 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 2 0 0 0
[pid=957/tid=973] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/973/stat : 973 (python) S 955 957 800 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 747571199 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 3 0 0 0
[pid=957/tid=977] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/977/stat : 977 (python) S 955 957 800 0 -1 4202560 102 936 0 0 0 0 0 0 19 0 9 0 747571202 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=980] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/980/stat : 980 (python) S 955 957 800 0 -1 4202560 34 936 0 0 0 0 0 0 20 0 9 0 747571205 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 5 0 0 0
[pid=957/tid=983] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/983/stat : 983 (python) S 955 957 800 0 -1 4202560 33 936 0 0 0 0 0 0 19 0 9 0 747571208 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=986] ppid=955 vsize=427308 CPUtime=0 cores=0-7
/proc/957/task/986/stat : 986 (python) S 955 957 800 0 -1 4202560 35 936 0 0 0 0 0 0 20 0 9 0 747571211 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 17.15
Current children cumulated vsize (KiB) 8184564

[startup+6.30163 s]
/proc/loadavg: 7.55 8.33 8.35 9/470 988
/proc/meminfo: memFree=12168352/32951124 swapFree=65586204/67111528
[pid=957] ppid=955 vsize=427308 CPUtime=1.09 cores=0-7
/proc/957/stat : 957 (python) S 955 957 800 0 -1 4202496 16160 936 1 0 99 10 0 0 20 0 9 0 747571093 437563392 7563 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/957/statm: 106827 7563 1891 364 0 42724 0
[pid=963] ppid=957 vsize=279416 CPUtime=0.02 cores=0-7
/proc/963/stat : 963 (python) S 957 957 800 0 -1 4202560 890 0 0 0 1 1 0 0 18 0 1 0 747571190 286121984 5815 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198735 0 0 16781312 514 7242440765257777409 0 0 17 1 0 0 0
/proc/963/statm: 69854 5815 377 364 0 5772 0
[pid=965] ppid=963 vsize=1018088 CPUtime=5.25 cores=0-7
/proc/965/stat : 965 (gnovelty+2) R 963 965 965 0 -1 4202496 571 0 0 0 525 0 0 0 25 0 1 0 747571191 1042522112 306 33554432000 134512640 135663704 4286964608 18446744073709551615 134525213 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/965/statm: 254522 306 113 282 0 254238 0
[pid=966] ppid=957 vsize=289992 CPUtime=0.02 cores=0-7
/proc/966/stat : 966 (python) S 957 957 800 0 -1 4202560 898 0 0 0 1 1 0 0 18 0 1 0 747571193 296951808 5861 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 16025655482647544067 0 0 17 1 0 0 0
/proc/966/statm: 72498 5861 371 364 0 8413 0
[pid=968] ppid=966 vsize=1018088 CPUtime=5.29 cores=0-7
/proc/968/stat : 968 (gnovelty+2) R 966 968 968 0 -1 4202496 573 0 0 0 529 0 0 0 25 0 1 0 747571193 1042522112 307 33554432000 134512640 135663704 4294501712 18446744073709551615 134547004 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/968/statm: 254522 307 113 282 0 254238 0
[pid=969] ppid=957 vsize=300248 CPUtime=0.01 cores=0-7
/proc/969/stat : 969 (python) S 957 957 800 0 -1 4202560 894 0 0 0 0 1 0 0 18 0 1 0 747571196 307453952 5865 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 4205847759695085827 0 0 17 1 0 0 0
/proc/969/statm: 75062 5865 371 364 0 10974 0
[pid=971] ppid=969 vsize=417192 CPUtime=5.25 cores=0-7
/proc/971/stat : 971 (adaptg2wsat2009) R 969 971 971 0 -1 4202496 761 0 0 0 525 0 0 0 25 0 1 0 747571196 427204608 496 33554432000 134512640 135107411 4288177936 18446744073709551615 134531731 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/971/statm: 104298 496 59 146 0 103174 0
[pid=972] ppid=957 vsize=310504 CPUtime=0.01 cores=0-7
/proc/972/stat : 972 (python) S 957 957 800 0 -1 4202560 927 0 0 0 1 0 0 0 18 0 1 0 747571199 317956096 5868 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 4249498371317793025 0 0 17 5 0 0 0
/proc/972/statm: 77626 5868 370 364 0 13535 0
[pid=974] ppid=972 vsize=417192 CPUtime=5.23 cores=0-7
/proc/974/stat : 974 (adaptg2wsat2009) R 972 974 974 0 -1 4202496 761 0 0 0 523 0 0 0 25 0 1 0 747571199 427204608 495 33554432000 134512640 135107411 4287977856 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/974/statm: 104298 495 59 146 0 103174 0
[pid=975] ppid=957 vsize=386296 CPUtime=0.01 cores=0-7
/proc/975/stat : 975 (python) S 957 957 800 0 -1 4202560 799 0 0 0 1 0 0 0 18 0 1 0 747571202 395567104 6046 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 648597240595579138 0 0 17 1 0 0 0
/proc/975/statm: 96574 6046 371 364 0 32480 0
[pid=978] ppid=975 vsize=417192 CPUtime=5.19 cores=0-7
/proc/978/stat : 978 (adaptg2wsat2009) R 975 978 978 0 -1 4202496 753 0 0 0 519 0 0 0 25 0 1 0 747571202 427204608 494 33554432000 134512640 135107411 4287000160 18446744073709551615 134539439 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/978/statm: 104298 494 59 146 0 103174 0
[pid=979] ppid=957 vsize=396552 CPUtime=0.01 cores=0-7
/proc/979/stat : 979 (python) S 957 957 800 0 -1 4202560 806 0 0 0 0 1 0 0 18 0 1 0 747571205 406069248 6014 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 9434187177979248899 0 0 17 1 0 0 0
/proc/979/statm: 99138 6014 371 364 0 35041 0
[pid=981] ppid=979 vsize=1018088 CPUtime=5.15 cores=0-7
/proc/981/stat : 981 (gnovelty+2) R 979 981 981 0 -1 4202496 563 0 0 0 515 0 0 0 25 0 1 0 747571205 1042522112 307 33554432000 134512640 135663704 4287251056 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/981/statm: 254522 307 113 282 0 254238 0
[pid=982] ppid=957 vsize=406808 CPUtime=0.01 cores=0-7
/proc/982/stat : 982 (python) S 957 957 800 0 -1 4202560 818 0 0 0 0 1 0 0 18 0 1 0 747571208 416571392 6017 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 2740717454480081156 0 0 17 1 0 0 0

################
# More data... #
################

[pid=1060/tid=1078] ppid=957 vsize=570904 CPUtime=0 cores=0-7
/proc/1060/task/1078/stat : 1078 (python) S 957 957 800 0 -1 4202560 82 0 0 0 0 0 0 0 18 0 2 0 747640798 584605696 6463 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604447788986496 0 0 -1 3 0 0 0
[pid=1064] ppid=957 vsize=581160 CPUtime=6.32 cores=0-7
/proc/1064/stat : 1064 (python) S 957 957 800 0 -1 4202560 1191 0 0 0 332 300 0 0 18 0 2 0 747621511 595107840 6426 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/1064/statm: 145290 6426 407 364 0 81139 0
[pid=1066] ppid=1064 vsize=455824 CPUtime=1743.49 cores=0-7
/proc/1066/stat : 1066 (TNM) R 1064 1066 1066 0 -1 4202496 719 0 0 0 174341 8 0 0 25 0 1 0 747621511 466763776 434 33554432000 134512640 135008748 4293392720 18446744073709551615 134527691 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1066/statm: 113956 434 46 122 0 112856 0
[pid=1064/tid=1151] ppid=957 vsize=581160 CPUtime=0 cores=0-7
/proc/1064/task/1151/stat : 1151 (python) S 957 957 800 0 -1 4202560 80 0 0 0 0 0 0 0 19 0 2 0 747777553 595107840 6426 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604447118478400 0 0 -1 2 0 0 0
[pid=1075] ppid=957 vsize=591416 CPUtime=0.35 cores=0-7
/proc/1075/stat : 1075 (python) S 957 957 800 0 -1 4202560 1183 0 0 0 17 18 0 0 19 0 2 0 747640661 605609984 6400 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1075/statm: 147854 6400 401 364 0 83700 0
[pid=1077] ppid=1075 vsize=335996 CPUtime=100.24 cores=0-7
/proc/1077/stat : 1077 (iPAWS) T 1075 1077 1077 0 -1 4202496 1371 0 0 0 10024 0 0 0 25 0 1 0 747640661 344059904 1088 33554432000 134512640 135114423 4292136624 18446744073709551615 134517345 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/1077/statm: 83999 1088 59 147 0 83851 0
[pid=1075/tid=1082] ppid=957 vsize=591416 CPUtime=0 cores=0-7
/proc/1075/task/1082/stat : 1082 (python) S 957 957 800 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 747650696 605609984 6400 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604440560714944 0 0 -1 1 0 0 0
[pid=1089] ppid=957 vsize=601672 CPUtime=0.36 cores=0-7
/proc/1089/stat : 1089 (python) S 957 957 800 0 -1 4202560 1194 0 0 0 19 17 0 0 19 0 2 0 747669839 616112128 6442 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1089/statm: 150418 6442 401 364 0 86261 0
[pid=1091] ppid=1089 vsize=335996 CPUtime=100.32 cores=0-7
/proc/1091/stat : 1091 (iPAWS) T 1089 1091 1091 0 -1 4202496 1373 0 0 0 10032 0 0 0 25 0 1 0 747669840 344059904 1090 33554432000 134512640 135114423 4293766384 18446744073709551615 134516646 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/1091/statm: 83999 1090 59 147 0 83851 0
[pid=1089/tid=1098] ppid=957 vsize=601672 CPUtime=0 cores=0-7
/proc/1089/task/1098/stat : 1098 (python) S 957 957 800 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 747679875 616112128 6442 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604447630637248 0 0 -1 7 0 0 0
[pid=1092] ppid=957 vsize=611928 CPUtime=0.74 cores=0-7
/proc/1092/stat : 1092 (python) S 957 957 800 0 -1 4202560 1191 0 0 0 38 36 0 0 18 0 2 0 747669865 626614272 6498 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1092/statm: 152982 6498 401 364 0 88822 0
[pid=1094] ppid=1092 vsize=247352 CPUtime=197.75 cores=0-7
/proc/1094/stat : 1094 (FH) T 1092 1094 1094 0 -1 4202496 726 0 0 0 19775 0 0 0 25 0 1 0 747669865 253288448 444 33554432000 134512640 134936988 4291389216 18446744073709551615 134552375 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/1094/statm: 61838 444 41 104 0 61342 0
[pid=1092/tid=1102] ppid=957 vsize=611928 CPUtime=0 cores=0-7
/proc/1092/task/1102/stat : 1102 (python) S 957 957 800 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 747679901 626614272 6498 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604443553798848 0 0 -1 0 0 0 0
[pid=1099] ppid=957 vsize=622184 CPUtime=4.4 cores=0-7
/proc/1099/stat : 1099 (python) S 957 957 800 0 -1 4202560 1209 0 0 0 226 214 0 0 15 0 2 0 747679881 637116416 6479 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1099/statm: 155546 6479 402 364 0 91383 0
[pid=1101] ppid=1099 vsize=138340 CPUtime=1163.64 cores=0-7
/proc/1101/stat : 1101 (march_hi) R 1099 1101 1101 0 -1 4202496 34769 0 0 0 116350 14 0 0 25 0 1 0 747679881 141660160 33200 33554432000 4194304 4955518 140733647684896 18446744073709551615 4297502 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1101/statm: 34585 33200 106 186 0 34398 0
[pid=1099/tid=1126] ppid=957 vsize=622184 CPUtime=0 cores=0-7
/proc/1099/task/1126/stat : 1126 (python) S 957 957 800 0 -1 4202560 86 0 0 0 0 0 0 0 15 0 2 0 747728900 637116416 6479 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604450522860352 0 0 -1 1 0 0 0
[pid=1103] ppid=957 vsize=632440 CPUtime=3.35 cores=0-7
/proc/1103/stat : 1103 (python) S 957 957 800 0 -1 4202560 1255 0 0 0 163 172 0 0 16 0 2 0 747679906 647618560 6544 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/1103/statm: 158110 6544 407 364 0 93944 0
[pid=1105] ppid=1103 vsize=138340 CPUtime=876.46 cores=0-7
/proc/1105/stat : 1105 (march_hi) T 1103 1105 1105 0 -1 4202496 26915 0 0 0 87637 9 0 0 25 0 1 0 747679907 141660160 25336 33554432000 4194304 4955518 140735738705328 18446744073709551615 4297483 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/1105/statm: 34585 25336 106 186 0 34398 0
[pid=1103/tid=1119] ppid=957 vsize=632440 CPUtime=0 cores=0-7
/proc/1103/task/1119/stat : 1119 (python) S 957 957 800 0 -1 4202560 87 0 0 0 0 0 0 0 15 0 2 0 747718984 647618560 6544 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604437422557952 0 0 -1 4 0 0 0
[pid=1122] ppid=957 vsize=642696 CPUtime=1.5 cores=0-7
/proc/1122/stat : 1122 (python) S 957 957 800 0 -1 4202560 1251 0 0 0 77 73 0 0 17 0 2 0 747727895 658120704 6487 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1122/statm: 160674 6487 408 364 0 96505 0
[pid=1124] ppid=1122 vsize=63560 CPUtime=389.02 cores=0-7
/proc/1124/stat : 1124 (march_hi) T 1122 1124 1124 0 -1 4202496 13542 0 0 0 38899 3 0 0 25 0 1 0 747727895 65085440 11971 33554432000 4194304 4955518 140733472840752 18446744073709551615 4297547 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/1124/statm: 15890 11971 106 186 0 15703 0
[pid=1122/tid=1141] ppid=957 vsize=642696 CPUtime=0 cores=0-7
/proc/1122/task/1141/stat : 1141 (python) S 957 957 800 0 -1 4202560 93 0 0 0 0 0 0 0 17 0 2 0 747767098 658120704 6487 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604448573018304 0 0 -1 1 0 0 0
[pid=1133] ppid=957 vsize=652952 CPUtime=1.87 cores=0-7
/proc/1133/stat : 1133 (python) S 957 957 800 0 -1 4202560 1256 0 0 0 98 89 0 0 15 0 2 0 747747811 668622848 6550 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1133/statm: 163238 6550 407 364 0 99066 0
[pid=1135] ppid=1133 vsize=63560 CPUtime=487.26 cores=0-7
/proc/1135/stat : 1135 (march_hi) T 1133 1135 1135 0 -1 4202496 16147 0 0 0 48721 5 0 0 25 0 1 0 747747812 65085440 14574 33554432000 4194304 4955518 140735546176096 18446744073709551615 4208667 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/1135/statm: 15890 14574 106 186 0 15703 0
[pid=1133/tid=1155] ppid=957 vsize=652952 CPUtime=0 cores=0-7
/proc/1133/task/1155/stat : 1155 (python) S 957 957 800 0 -1 4202560 89 0 0 0 0 0 0 0 15 0 2 0 747786788 668622848 6550 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604448619047040 0 0 -1 2 0 0 0
[pid=1142] ppid=957 vsize=663208 CPUtime=1.08 cores=0-7
/proc/1142/stat : 1142 (python) S 957 957 800 0 -1 4202560 1258 0 0 0 59 49 0 0 18 0 2 0 747767103 679124992 6474 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1142/statm: 165802 6474 408 364 0 101627 0
[pid=1144] ppid=1142 vsize=268424 CPUtime=294.39 cores=0-7
/proc/1144/stat : 1144 (hybridGM3) R 1142 1144 1144 0 -1 4202496 4964 0 0 0 29439 0 0 0 25 0 1 0 747767103 274866176 4672 33554432000 134512640 135204385 4294823824 18446744073709551615 134537558 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1144/statm: 67106 4672 64 169 0 66936 0
[pid=1142/tid=1154] ppid=957 vsize=663208 CPUtime=0 cores=0-7
/proc/1142/task/1154/stat : 1154 (python) S 957 957 800 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 747786775 679124992 6474 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 514 18446604437709314176 0 0 -1 5 0 0 0
[pid=1145] ppid=957 vsize=673464 CPUtime=1.1 cores=0-7
/proc/1145/stat : 1145 (python) S 957 957 800 0 -1 4202560 1074 0 0 0 58 52 0 0 15 0 1 0 747768020 689627136 6511 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 9033358835389006084 0 0 17 2 0 0 0
/proc/1145/statm: 168366 6511 378 364 0 104188 0
[pid=1147] ppid=1145 vsize=43360 CPUtime=285.59 cores=0-7
/proc/1147/stat : 1147 (march_hi) R 1145 1147 1147 0 -1 4202496 10622 0 0 0 28554 5 0 0 25 0 1 0 747768021 44400640 9047 33554432000 4194304 4955518 140735127731808 18446744073709551615 4235583 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1147/statm: 10840 9047 106 186 0 10653 0
[pid=1159] ppid=957 vsize=683720 CPUtime=0 cores=0-7
/proc/1159/stat : 1159 (python) S 957 957 800 0 -1 4202560 938 0 0 0 0 0 0 0 19 0 1 0 747796706 700129280 6500 33554432000 4194304 5683644 140737265215104 18446744073709551615 216735198790 0 0 16781312 514 9552654608069820415 0 0 17 0 0 0 0
/proc/1159/statm: 170930 6500 350 364 0 106749 0
[pid=1161] ppid=1159 vsize=1018088 CPUtime=0.99 cores=0-7
/proc/1161/stat : 1161 (gnovelty+2) R 1159 1161 1161 0 -1 4202496 595 0 0 0 99 0 0 0 23 0 1 0 747796707 1042522112 305 33554432000 134512640 135663704 4294499056 18446744073709551615 134525544 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1161/statm: 254522 305 113 282 0 254238 0
[pid=957/tid=964] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/964/stat : 964 (python) S 955 957 800 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 35 0 747571190 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 6 0 0 0
[pid=957/tid=967] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/967/stat : 967 (python) S 955 957 800 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 35 0 747571193 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=970] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/970/stat : 970 (python) S 955 957 800 0 -1 4202560 38 936 0 0 0 0 0 0 15 0 35 0 747571196 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 2 0 0 0
[pid=957/tid=973] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/973/stat : 973 (python) S 955 957 800 0 -1 4202560 36 936 0 0 0 0 0 0 16 0 35 0 747571199 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 3 0 0 0
[pid=957/tid=977] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/977/stat : 977 (python) S 955 957 800 0 -1 4202560 111 936 0 0 0 0 0 0 15 0 35 0 747571202 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=980] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/980/stat : 980 (python) S 955 957 800 0 -1 4202560 34 936 0 0 0 0 0 0 20 0 35 0 747571205 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 5 0 0 0
[pid=957/tid=983] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/983/stat : 983 (python) S 955 957 800 0 -1 4202560 33 936 0 0 0 0 0 0 19 0 35 0 747571208 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=986] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/986/stat : 986 (python) S 955 957 800 0 -1 4202560 49 936 0 0 0 0 0 0 18 0 35 0 747571211 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=993] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/993/stat : 993 (python) S 955 957 800 0 -1 4202560 58 936 0 0 0 0 0 0 18 0 35 0 747581228 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 4 0 0 0
[pid=957/tid=999] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/999/stat : 999 (python) S 955 957 800 0 -1 4202560 33 936 0 0 0 0 0 0 21 0 35 0 747581233 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 4 0 0 0
[pid=957/tid=1003] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1003/stat : 1003 (python) S 955 957 800 0 -1 4202560 48 936 0 0 0 0 0 0 18 0 35 0 747581236 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 5 0 0 0
[pid=957/tid=1007] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1007/stat : 1007 (python) S 955 957 800 0 -1 4202560 33 936 0 0 0 0 0 0 20 0 35 0 747581240 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 2 0 0 0
[pid=957/tid=1011] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1011/stat : 1011 (python) S 955 957 800 0 -1 4202560 39 936 0 0 0 0 0 0 18 0 35 0 747581244 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 4 0 0 0
[pid=957/tid=1018] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1018/stat : 1018 (python) S 955 957 800 0 -1 4202560 44 936 0 0 0 0 0 0 18 0 35 0 747590787 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=1021] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1021/stat : 1021 (python) S 955 957 800 0 -1 4202560 51 936 0 0 0 0 0 0 18 0 35 0 747590792 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1025] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1025/stat : 1025 (python) S 955 957 800 0 -1 4202560 51 936 0 0 0 0 0 0 18 0 35 0 747591265 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1029] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1029/stat : 1029 (python) S 955 957 800 0 -1 4202560 35 936 0 0 0 0 0 0 21 0 35 0 747591270 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1033] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1033/stat : 1033 (python) S 955 957 800 0 -1 4202560 45 936 0 0 0 0 0 0 18 0 35 0 747591281 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1041] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1041/stat : 1041 (python) S 955 957 800 0 -1 4202560 55 936 0 0 0 0 0 0 18 0 35 0 747601319 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1049] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1049/stat : 1049 (python) S 955 957 800 0 -1 4202560 38 936 0 0 0 0 0 0 20 0 35 0 747611467 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1055] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1055/stat : 1055 (python) S 955 957 800 0 -1 4202560 38 936 0 0 0 0 0 0 18 0 35 0 747620585 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1058] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1058/stat : 1058 (python) S 955 957 800 0 -1 4202560 38 936 0 0 0 0 0 0 18 0 35 0 747620796 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1061] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1061/stat : 1061 (python) S 955 957 800 0 -1 4202560 39 936 0 0 0 0 0 0 18 0 35 0 747621126 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=1065] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1065/stat : 1065 (python) S 955 957 800 0 -1 4202560 43 936 0 0 0 0 0 0 18 0 35 0 747621511 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1076] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1076/stat : 1076 (python) S 955 957 800 0 -1 4202560 38 936 0 0 0 0 0 0 20 0 35 0 747640661 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=1090] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1090/stat : 1090 (python) S 955 957 800 0 -1 4202560 44 936 0 0 0 0 0 0 20 0 35 0 747669840 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=1093] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1093/stat : 1093 (python) S 955 957 800 0 -1 4202560 40 936 0 0 0 0 0 0 18 0 35 0 747669865 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1100] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1100/stat : 1100 (python) S 955 957 800 0 -1 4202560 44 936 0 0 0 0 0 0 18 0 35 0 747679881 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=1104] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1104/stat : 1104 (python) S 955 957 800 0 -1 4202560 41 936 0 0 0 0 0 0 18 0 35 0 747679907 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1123] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1123/stat : 1123 (python) S 955 957 800 0 -1 4202560 41 936 0 0 0 0 0 0 20 0 35 0 747727895 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1134] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1134/stat : 1134 (python) S 955 957 800 0 -1 4202560 39 936 0 0 0 0 0 0 18 0 35 0 747747812 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
[pid=957/tid=1143] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1143/stat : 1143 (python) S 955 957 800 0 -1 4202560 35 936 0 0 0 0 0 0 18 0 35 0 747767103 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1146] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1146/stat : 1146 (python) S 955 957 800 0 -1 4202560 33 936 0 0 0 0 0 0 20 0 35 0 747768021 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 0 0 0 0
[pid=957/tid=1160] ppid=955 vsize=693964 CPUtime=0 cores=0-7
/proc/957/task/1160/stat : 1160 (python) S 955 957 800 0 -1 4202560 39 936 0 0 0 0 0 0 20 0 35 0 747796706 710619136 8098 33554432000 4194304 5683644 140737265215104 18446744073709551615 216747002289 0 0 16781312 2 18446604448573020992 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 17958.2
Current children cumulated vsize (KiB) 32044352

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 957 and gives
#  childrusage.ru_utime.tv_sec=1781
#  childrusage.ru_utime.tv_usec=942103
#  childrusage.ru_stime.tv_sec=31
#  childrusage.ru_stime.tv_usec=260247
# CPU time returned by wait4() is 1813.2
# while last known CPU time is 17958.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2257.32
CPU time (s): 17958.2
CPU user time (s): 17925.7
CPU system time (s): 32.57
CPU usage (%): 795.554
Max. virtual memory (cumulated for all children) (KiB): 32044352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1781.94
system time used= 31.2602
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 114954
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24434
involuntary context switches= 9499

runsolver used 29.0176 second user time and 59.9249 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-16 21:16:44
IDJOB=3385767
IDBENCH=83032
IDSOLVER=1870
FILE ID=node119/3385767-1305573404
RUNJOBID= node119-1305573364-814
PBS_JOBID= 13350159
Free space on /tmp= 73068 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v90-c8010-S741717046-057.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385767-1305573404/watcher-3385767-1305573404 -o /tmp/evaluation-result-3385767-1305573404/solver-3385767-1305573404 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385767-1305573404.cnf -seed 60023278 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1f00de1fd8adbfbf4cc573ef44af531f
RANDOM SEED=60023278

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12234180 kB
Buffers:        319460 kB
Cached:        5555076 kB
SwapCached:       4756 kB
Active:       16576460 kB
Inactive:      3781340 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12234180 kB
SwapTotal:    67111528 kB
SwapFree:     65586204 kB
Dirty:           32372 kB
Writeback:           0 kB
AnonPages:    14482104 kB
Mapped:          34388 kB
Slab:           217740 kB
PageTables:      68704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 130396572 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73036 MiB
End job on node119 at 2011-05-16 21:54:24