Trace number 3321833

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9490.97 1193.61

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S969405384-096-UNKNOWN.cnf
MD5SUM6e345981a96012731da9bd2ce5420289
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1088.25
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.34/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.68	c INFO: solving HOME/instance-3321833-1304368060.cnf
0.34/0.68	c INFO: computing task features
0.52/0.83	c INFO: computed variable-clause graph statistics
0.52/0.84	c INFO: computed clause balance statistics
1.31/1.66	c INFO: computed variable balance statistics
1.82/2.11	c INFO: computed small-clause counts
1.82/2.11	c INFO: computed Horn-clause counts
1.82/2.15	c INFO: computed variable graph statistics
1.82/2.15	c INFO: collected features for HOME/instance-3321833-1304368060.cnf in 1.47 s
1.82/2.18	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
1.92/2.22	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.14)
1.92/2.26	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.09)
1.92/2.29	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.01/2.33	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.06)
2.01/2.37	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.05)
2.11/2.41	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.04)
2.11/2.45	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
793.67/101.49	c INFO: running adaptg2wsat2009++@0 for 97 with 39899 remaining (b = 0.03)
801.64/102.45	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
802.39/102.50	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.39/102.55	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.93/102.61	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.93/102.67	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
803.19/102.73	c INFO: running TNM@0 for 1552 with 39897 remaining (b = 0.21)
803.19/102.79	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
1593.40/201.75	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1594.83/201.90	c INFO: running hybridGM3@0 for 194 with 39798 remaining (b = 0.02)
1601.31/202.71	c INFO: running adaptg2wsat2009++@0 for 97 with 39798 remaining (b = 0.01)
1603.70/203.07	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2353.12/297.07	c INFO: running hybridGM3@100 for 97 with 39703 remaining (b = 0.01)
2370.67/299.26	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2371.39/299.35	c INFO: running adaptg2wsat2009++@0 for 97 with 39701 remaining (b = 0.01)
2376.19/299.99	c INFO: running adaptg2wsat2009++@99 for 97 with 39700 remaining (b = 0.01)
2392.90/302.03	c INFO: running gnovelty+2@0 for 97 with 39698 remaining (b = 0.01)
2418.41/305.22	c INFO: running hybridGM3@98 for 97 with 39695 remaining (b = 0.01)
3130.25/394.53	c INFO: running hybridGM3@0 for 194 with 39606 remaining (b = 0.02)
3143.77/396.30	c INFO: running hybridGM3@0 for 194 with 39604 remaining (b = 0.02)
3146.67/396.63	c INFO: running TNM@0 for 1552 with 39604 remaining (b = 0.14)
3152.51/397.39	c INFO: running hybridGM3@296 for 97 with 39603 remaining (b = 0.01)
3153.31/397.49	c INFO: running hybridGM3@100 for 97 with 39603 remaining (b = 0.01)
3177.27/400.49	c INFO: running hybridGM3@194 for 97 with 39600 remaining (b = 0.01)
3192.32/402.36	c INFO: running adaptg2wsat2009++@100 for 97 with 39598 remaining (b = 0.01)
3904.12/491.66	c INFO: running FH@0 for 291 with 39509 remaining (b = 0.03)
3960.64/498.78	c INFO: running iPAWS@0 for 97 with 39501 remaining (b = 0.01)
3967.77/499.65	c INFO: running adaptg2wsat2009++@100 for 97 with 39501 remaining (b = 0.01)
3984.51/501.78	c INFO: running hybridGM3@291 for 97 with 39498 remaining (b = 0.01)
4695.32/590.94	c INFO: running hybridGM3@97 for 97 with 39409 remaining (b = 0.01)
4696.92/591.11	c INFO: running hybridGM3@96 for 97 with 39409 remaining (b = 0.01)
4743.07/596.93	c INFO: running hybridGM3@0 for 194 with 39403 remaining (b = 0.02)
4791.62/603.07	c INFO: running FH@100 for 291 with 39397 remaining (b = 0.03)
4800.36/604.11	c INFO: running hybridGM3@0 for 194 with 39396 remaining (b = 0.02)
5454.86/686.39	c INFO: running iPAWS@0 for 97 with 39314 remaining (b = 0.01)
5501.76/692.23	c INFO: running hybridGM3@293 for 194 with 39308 remaining (b = 0.02)
6254.12/786.75	c INFO: running adaptg2wsat2009++@99 for 97 with 39214 remaining (b = 0.01)
6298.69/792.38	c INFO: running gnovelty+2@0 for 97 with 39208 remaining (b = 0.01)
6300.20/792.59	c INFO: running hybridGM3@193 for 97 with 39208 remaining (b = 0.01)
6357.68/799.73	c INFO: running hybridGM3@100 for 97 with 39201 remaining (b = 0.01)
7026.39/883.71	c INFO: running hybridGM3@393 for 97 with 39117 remaining (b = 0.01)
7028.75/884.06	c INFO: running adaptg2wsat2009++@392 for 194 with 39116 remaining (b = 0.02)
7075.02/889.89	c INFO: running hybridGM3@387 for 194 with 39110 remaining (b = 0.02)
7097.99/892.75	c INFO: running TNM@0 for 1552 with 39108 remaining (b = 0.11)
7098.69/892.86	c INFO: running FH@202 for 194 with 39107 remaining (b = 0.01)
7132.15/897.04	c INFO: running FH@0 for 97 with 39103 remaining (b = 0.01)
7824.76/984.06	c INFO: running hybridGM3@95 for 97 with 39016 remaining (b = 0.01)
7922.67/996.39	c INFO: running NCVWr@0 for 485 with 39004 remaining (b = 0.03)
8553.09/1075.58	c INFO: running adaptg2wsat2009++@489 for 97 with 38925 remaining (b = 0.01)
8599.30/1081.39	c INFO: running hybridGM3@193 for 97 with 38919 remaining (b = 0.01)
8640.63/1086.57	c INFO: running iPAWS@0 for 97 with 38914 remaining (b = 0.01)
8670.82/1090.39	c INFO: running FH@299 for 97 with 38910 remaining (b = 0.01)
9358.79/1176.91	c INFO: running FH@99 for 291 with 38823 remaining (b = 0.02)
9397.79/1181.76	c INFO: running hybridGM3@389 for 97 with 38819 remaining (b = 0.01)
9428.84/1185.71	c INFO: running hybridGM3@0 for 194 with 38815 remaining (b = 0.01)
9486.85/1192.93	c INFO: running TNM@0 for 1552 with 38807 remaining (b = 0.08)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321833-1304368060/watcher-3321833-1304368060 -o /tmp/evaluation-result-3321833-1304368060/solver-3321833-1304368060 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321833-1304368060.cnf -seed 1132285276 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.65 2.37 1.60 2/256 21913
/proc/meminfo: memFree=23619248/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=15384 CPUtime=0 cores=0-7
/proc/21913/stat : 21913 (python) R 21911 21913 21696 0 -1 4202496 811 0 0 0 0 0 0 0 17 0 1 0 548402747 15753216 697 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500687796 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/21913/statm: 3846 698 334 364 0 333 0

[startup+0.054076 s]
/proc/loadavg: 5.65 2.37 1.60 2/256 21913
/proc/meminfo: memFree=23619248/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=25288 CPUtime=0.03 cores=0-7
/proc/21913/stat : 21913 (python) S 21911 21913 21696 0 -1 4202496 1344 0 0 0 3 0 0 0 17 0 1 0 548402747 25894912 1191 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500689920 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/21913/statm: 6322 1191 438 364 0 723 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 25288

[startup+0.101083 s]
/proc/loadavg: 5.65 2.37 1.60 2/256 21913
/proc/meminfo: memFree=23619248/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=87704 CPUtime=0.06 cores=0-7
/proc/21913/stat : 21913 (python) R 21911 21913 21696 0 -1 4202496 2637 0 0 0 5 1 0 0 17 0 1 0 548402747 89808896 2354 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500687796 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/21913/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.301065 s]
/proc/loadavg: 5.65 2.37 1.60 2/256 21913
/proc/meminfo: memFree=23619248/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=135748 CPUtime=0.18 cores=0-7
/proc/21913/stat : 21913 (python) R 21911 21913 21696 0 -1 4202496 5965 932 1 0 15 3 0 0 17 0 1 0 548402747 139005952 4151 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500687877 0 2147483391 16781312 2 0 0 0 17 6 0 0 0
/proc/21913/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.70095 s]
/proc/loadavg: 5.65 2.37 1.60 2/256 21913
/proc/meminfo: memFree=23619248/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=280224 CPUtime=0.42 cores=0-7
/proc/21913/stat : 21913 (python) R 21911 21913 21696 0 -1 4202496 9694 932 1 0 33 9 0 0 16 0 1 0 548402747 286949376 7374 33554432000 4194304 5683644 140737202947120 18446744073709551615 4602370 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/21913/statm: 70056 7376 1761 364 0 5980 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 280224

[startup+1.50079 s]
/proc/loadavg: 5.65 2.37 1.60 2/257 21918
/proc/meminfo: memFree=23588180/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=287588 CPUtime=1.21 cores=0-7
/proc/21913/stat : 21913 (python) R 21911 21913 21696 0 -1 4202496 12684 932 1 0 112 9 0 0 17 0 1 0 548402747 294490112 9282 33554432000 4194304 5683644 140737202947120 18446744073709551615 47916138035136 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/21913/statm: 71897 9282 1826 364 0 7821 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 287588

[startup+3.10038 s]
/proc/loadavg: 5.65 2.37 1.60 2/257 21918
/proc/meminfo: memFree=23588044/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=430604 CPUtime=2.17 cores=0-7
/proc/21913/stat : 21913 (python) S 21911 21913 21696 0 -1 4202496 18686 932 1 0 205 12 0 0 20 0 9 0 548402747 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/21913/statm: 107651 8361 1891 364 0 43548 0
Current children cumulated CPU time (s) 2.17
Current children cumulated vsize (KiB) 430604
heavy processes:

[startup+6.30175 s]
/proc/loadavg: 5.35 2.36 1.61 9/281 21942
/proc/meminfo: memFree=23519908/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=430604 CPUtime=2.17 cores=0-7
/proc/21913/stat : 21913 (python) S 21911 21913 21696 0 -1 4202496 18686 932 1 0 205 12 0 0 20 0 9 0 548402747 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/21913/statm: 107651 8361 1891 364 0 43548 0
[pid=21919] ppid=21913 vsize=283516 CPUtime=0 cores=0-7
/proc/21919/stat : 21919 (python) S 21913 21913 21696 0 -1 4202560 895 0 0 0 0 0 0 0 18 0 1 0 548402966 290320384 6607 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500711951 0 0 16781312 514 4161603136915472642 0 0 17 1 0 0 0
/proc/21919/statm: 70879 6607 378 364 0 6797 0
[pid=21921] ppid=21919 vsize=1018996 CPUtime=4.11 cores=0-7
/proc/21921/stat : 21921 (gnovelty+2) R 21919 21921 21921 0 -1 4202496 963 0 0 0 411 0 0 0 25 0 1 0 548402966 1043451904 697 33554432000 134512640 135663704 4289559952 18446744073709551615 134525479 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/21921/statm: 254749 697 113 282 0 254465 0
[pid=21922] ppid=21913 vsize=293704 CPUtime=0 cores=0-7
/proc/21922/stat : 21922 (python) S 21913 21913 21696 0 -1 4202560 904 0 0 0 0 0 0 0 18 0 1 0 548402970 300752896 6688 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 4161595440334078212 0 0 17 7 0 0 0
/proc/21922/statm: 73426 6688 372 364 0 9341 0
[pid=21924] ppid=21922 vsize=1018996 CPUtime=4.07 cores=0-7
/proc/21924/stat : 21924 (gnovelty+2) R 21922 21924 21924 0 -1 4202496 959 0 0 0 407 0 0 0 25 0 1 0 548402970 1043451904 697 33554432000 134512640 135663704 4288642480 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21924/statm: 254749 697 113 282 0 254465 0
[pid=21925] ppid=21913 vsize=369080 CPUtime=0 cores=0-7
/proc/21925/stat : 21925 (python) S 21913 21913 21696 0 -1 4202560 778 0 0 0 0 0 0 0 18 0 1 0 548402974 377937920 6862 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 11988287818116858113 0 0 17 1 0 0 0
/proc/21925/statm: 92270 6862 370 364 0 28182 0
[pid=21927] ppid=21925 vsize=421428 CPUtime=4.02 cores=0-7
/proc/21927/stat : 21927 (adaptg2wsat2009) R 21925 21927 21927 0 -1 4202496 2038 0 0 0 402 0 0 0 25 0 1 0 548402974 431542272 1782 33554432000 134512640 135107411 4289176272 18446744073709551615 134532107 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/21927/statm: 105357 1782 59 146 0 104233 0
[pid=21928] ppid=21913 vsize=379336 CPUtime=0 cores=0-7
/proc/21928/stat : 21928 (python) S 21913 21913 21696 0 -1 4202560 719 0 0 0 0 0 0 0 18 0 1 0 548402977 388440064 6798 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 3521609029346361601 0 0 17 7 0 0 0
/proc/21928/statm: 94834 6798 348 364 0 30743 0
[pid=21930] ppid=21928 vsize=421428 CPUtime=3.99 cores=0-7
/proc/21930/stat : 21930 (adaptg2wsat2009) R 21928 21930 21930 0 -1 4202496 2038 0 0 0 399 0 0 0 25 0 1 0 548402978 431542272 1781 33554432000 134512640 135107411 4290886608 18446744073709551615 134532326 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21930/statm: 105357 1781 59 146 0 104233 0
[pid=21931] ppid=21913 vsize=389592 CPUtime=0 cores=0-7
/proc/21931/stat : 21931 (python) S 21913 21913 21696 0 -1 4202560 721 0 0 0 0 0 0 0 18 0 1 0 548402981 398942208 6922 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 3521605181055664386 0 0 17 1 0 0 0
/proc/21931/statm: 97398 6922 348 364 0 33304 0
[pid=21933] ppid=21931 vsize=421428 CPUtime=3.95 cores=0-7
/proc/21933/stat : 21933 (adaptg2wsat2009) R 21931 21933 21933 0 -1 4202496 2041 0 0 0 395 0 0 0 25 0 1 0 548402981 431542272 1783 33554432000 134512640 135107411 4289241056 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/21933/statm: 105357 1783 59 146 0 104233 0
[pid=21934] ppid=21913 vsize=399848 CPUtime=0 cores=0-7
/proc/21934/stat : 21934 (python) S 21913 21913 21696 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 548402985 409444352 6926 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 4116027005554622722 0 0 17 1 0 0 0
/proc/21934/statm: 99962 6926 348 364 0 35865 0
[pid=21936] ppid=21934 vsize=1018996 CPUtime=3.86 cores=0-7
/proc/21936/stat : 21936 (gnovelty+2) R 21934 21936 21936 0 -1 4202496 957 0 0 0 386 0 0 0 25 0 1 0 548402985 1043451904 698 33554432000 134512640 135663704 4287087792 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/21936/statm: 254749 698 113 282 0 254465 0
[pid=21937] ppid=21913 vsize=410104 CPUtime=0 cores=0-7
/proc/21937/stat : 21937 (python) S 21913 21913 21696 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 548402989 419946496 6844 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 5723613335799169283 0 0 17 1 0 0 0
/proc/21937/statm: 102526 6844 348 364 0 38426 0
[pid=21939] ppid=21937 vsize=251292 CPUtime=3.84 cores=0-7
/proc/21939/stat : 21939 (FH) R 21937 21939 21939 0 -1 4202496 1944 0 0 0 384 0 0 0 25 0 1 0 548402990 257323008 1683 33554432000 134512640 134936988 4293809456 18446744073709551615 134552636 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/21939/statm: 62823 1683 41 104 0 62327 0
[pid=21940] ppid=21913 vsize=420360 CPUtime=0 cores=0-7
/proc/21940/stat : 21940 (python) S 21913 21913 21696 0 -1 4202560 768 0 0 0 0 0 0 0 18 0 1 0 548402993 430448640 6820 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 5723609487508472068 0 0 17 6 0 0 0
/proc/21940/statm: 105090 6820 354 364 0 40987 0
[pid=21942] ppid=21940 vsize=421428 CPUtime=3.82 cores=0-7
/proc/21942/stat : 21942 (adaptg2wsat2009) R 21940 21942 21942 0 -1 4202496 2048 0 0 0 382 0 0 0 25 0 1 0 548402993 431542272 1783 33554432000 134512640 135107411 4286661504 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/21942/statm: 105357 1783 59 146 0 104233 0
[pid=21913/tid=21920] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21920/stat : 21920 (python) S 21911 21913 21696 0 -1 4202560 25 932 0 0 0 0 0 0 19 0 9 0 548402966 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21923] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21923/stat : 21923 (python) S 21911 21913 21696 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 9 0 548402970 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 3 0 0 0
[pid=21913/tid=21926] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21926/stat : 21926 (python) S 21911 21913 21696 0 -1 4202560 88 932 0 0 0 0 0 0 19 0 9 0 548402974 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21929] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21929/stat : 21929 (python) S 21911 21913 21696 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 9 0 548402977 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 5 0 0 0
[pid=21913/tid=21932] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21932/stat : 21932 (python) S 21911 21913 21696 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 548402981 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21935] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21935/stat : 21935 (python) S 21911 21913 21696 0 -1 4202560 32 932 0 0 0 0 0 0 21 0 9 0 548402985 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 7 0 0 0
[pid=21913/tid=21938] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21938/stat : 21938 (python) S 21911 21913 21696 0 -1 4202560 33 932 0 0 0 0 0 0 19 0 9 0 548402989 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=21941] ppid=21911 vsize=430604 CPUtime=0 cores=0-7
/proc/21913/task/21941/stat : 21941 (python) S 21911 21913 21696 0 -1 4202560 82 932 0 0 0 0 0 0 21 0 9 0 548402993 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 33.83
Current children cumulated vsize (KiB) 8370136

[startup+12.7015 s]
/proc/loadavg: 5.57 2.45 1.64 9/281 21943
/proc/meminfo: memFree=23519580/32950928 swapFree=54880832/67111528
[pid=21913] ppid=21911 vsize=430604 CPUtime=2.17 cores=0-7
/proc/21913/stat : 21913 (python) S 21911 21913 21696 0 -1 4202496 18686 932 1 0 205 12 0 0 20 0 9 0 548402747 440938496 8361 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/21913/statm: 107651 8361 1891 364 0 43548 0
[pid=21919] ppid=21913 vsize=283516 CPUtime=0.01 cores=0-7
/proc/21919/stat : 21919 (python) S 21913 21913 21696 0 -1 4202560 900 0 0 0 0 1 0 0 18 0 1 0 548402966 290320384 6607 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500711951 0 0 16781312 514 6150069911453401346 0 0 17 1 0 0 0
/proc/21919/statm: 70879 6607 378 364 0 6797 0
[pid=21921] ppid=21919 vsize=1018996 CPUtime=10.51 cores=0-7
/proc/21921/stat : 21921 (gnovelty+2) R 21919 21921 21921 0 -1 4202496 963 0 0 0 1051 0 0 0 25 0 1 0 548402966 1043451904 697 33554432000 134512640 135663704 4289559952 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/21921/statm: 254749 697 113 282 0 254465 0
[pid=21922] ppid=21913 vsize=293704 CPUtime=0.01 cores=0-7
/proc/21922/stat : 21922 (python) S 21913 21913 21696 0 -1 4202560 907 0 0 0 0 1 0 0 18 0 1 0 548402970 300752896 6688 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401348 0 0 17 7 0 0 0
/proc/21922/statm: 73426 6688 372 364 0 9341 0
[pid=21924] ppid=21922 vsize=1018996 CPUtime=10.47 cores=0-7
/proc/21924/stat : 21924 (gnovelty+2) R 21922 21924 21924 0 -1 4202496 959 0 0 0 1047 0 0 0 25 0 1 0 548402970 1043451904 697 33554432000 134512640 135663704 4288642480 18446744073709551615 134544264 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21924/statm: 254749 697 113 282 0 254465 0
[pid=21925] ppid=21913 vsize=369080 CPUtime=0.01 cores=0-7
/proc/21925/stat : 21925 (python) S 21913 21913 21696 0 -1 4202560 780 0 0 0 0 1 0 0 18 0 1 0 548402974 377937920 6863 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401345 0 0 17 1 0 0 0
/proc/21925/statm: 92270 6863 371 364 0 28182 0
[pid=21927] ppid=21925 vsize=421428 CPUtime=10.42 cores=0-7
/proc/21927/stat : 21927 (adaptg2wsat2009) R 21925 21927 21927 0 -1 4202496 2038 0 0 0 1042 0 0 0 25 0 1 0 548402974 431542272 1782 33554432000 134512640 135107411 4289176272 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/21927/statm: 105357 1782 59 146 0 104233 0
[pid=21928] ppid=21913 vsize=379336 CPUtime=0.02 cores=0-7
/proc/21928/stat : 21928 (python) S 21913 21913 21696 0 -1 4202560 796 0 0 0 1 1 0 0 18 0 1 0 548402977 388440064 6821 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401345 0 0 17 7 0 0 0
/proc/21928/statm: 94834 6821 371 364 0 30743 0
[pid=21930] ppid=21928 vsize=421428 CPUtime=10.39 cores=0-7
/proc/21930/stat : 21930 (adaptg2wsat2009) R 21928 21930 21930 0 -1 4202496 2038 0 0 0 1039 0 0 0 25 0 1 0 548402978 431542272 1781 33554432000 134512640 135107411 4290886608 18446744073709551615 134539283 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21930/statm: 105357 1781 59 146 0 104233 0
[pid=21931] ppid=21913 vsize=389592 CPUtime=0.02 cores=0-7
/proc/21931/stat : 21931 (python) S 21913 21913 21696 0 -1 4202560 800 0 0 0 1 1 0 0 18 0 1 0 548402981 398942208 6945 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401346 0 0 17 1 0 0 0
/proc/21931/statm: 97398 6945 371 364 0 33304 0
[pid=21933] ppid=21931 vsize=421428 CPUtime=10.35 cores=0-7
/proc/21933/stat : 21933 (adaptg2wsat2009) R 21931 21933 21933 0 -1 4202496 2041 0 0 0 1035 0 0 0 25 0 1 0 548402981 431542272 1783 33554432000 134512640 135107411 4289241056 18446744073709551615 134531674 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/21933/statm: 105357 1783 59 146 0 104233 0
[pid=21934] ppid=21913 vsize=399848 CPUtime=0.02 cores=0-7
/proc/21934/stat : 21934 (python) S 21913 21913 21696 0 -1 4202560 814 0 0 0 1 1 0 0 18 0 1 0 548402985 409444352 6949 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401346 0 0 17 1 0 0 0
/proc/21934/statm: 99962 6949 371 364 0 35865 0
[pid=21936] ppid=21934 vsize=1018996 CPUtime=10.16 cores=0-7
/proc/21936/stat : 21936 (gnovelty+2) R 21934 21936 21936 0 -1 4202496 957 0 0 0 1016 0 0 0 25 0 1 0 548402985 1043451904 698 33554432000 134512640 135663704 4287087792 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/21936/statm: 254749 698 113 282 0 254465 0
[pid=21937] ppid=21913 vsize=410104 CPUtime=0.02 cores=0-7
/proc/21937/stat : 21937 (python) S 21913 21913 21696 0 -1 4202560 823 0 0 0 1 1 0 0 18 0 1 0 548402989 419946496 6867 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401347 0 0 17 1 0 0 0

################
# More data... #
################

[pid=22011] ppid=22009 vsize=459768 CPUtime=796.01 cores=0-7
/proc/22011/stat : 22011 (TNM) R 22009 22011 22011 0 -1 4202496 1936 0 0 0 79601 0 0 0 25 0 1 0 548442411 470802432 1653 33554432000 134512640 135008748 4288884768 18446744073709551615 134529084 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/22011/statm: 114942 1653 46 122 0 113842 0
[pid=22017] ppid=21913 vsize=574200 CPUtime=0.23 cores=0-7
/proc/22017/stat : 22017 (python) S 21913 21913 21696 0 -1 4202560 1194 0 0 0 13 10 0 0 18 0 2 0 548452626 587980800 7189 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/22017/statm: 143550 7189 407 364 0 79402 0
[pid=22019] ppid=22017 vsize=335996 CPUtime=101.85 cores=0-7
/proc/22019/stat : 22019 (iPAWS) T 22017 22019 22019 0 -1 4202496 1829 0 0 0 10184 1 0 0 25 0 1 0 548452626 344059904 1548 33554432000 134512640 135114423 4288476592 18446744073709551615 134516698 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/22019/statm: 83999 1548 59 147 0 83851 0
[pid=22017/tid=22027] ppid=21913 vsize=574200 CPUtime=0 cores=0-7
/proc/22017/task/22027/stat : 22027 (python) S 21913 21913 21696 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 548463149 587980800 7189 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604444963668160 0 0 -1 7 0 0 0
[pid=22024] ppid=21913 vsize=584456 CPUtime=0.65 cores=0-7
/proc/22024/stat : 22024 (python) S 21913 21913 21696 0 -1 4202560 1210 0 0 0 34 31 0 0 18 0 2 0 548462441 598482944 7195 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/22024/statm: 146114 7195 407 364 0 81963 0
[pid=22026] ppid=22024 vsize=268420 CPUtime=292.5 cores=0-7
/proc/22026/stat : 22026 (hybridGM3) T 22024 22026 22026 0 -1 4202496 5827 0 0 0 29249 1 0 0 25 0 1 0 548462442 274862080 5543 33554432000 134512640 135204385 4289367408 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/22026/statm: 67105 5543 63 169 0 66935 0
[pid=22024/tid=22043] ppid=21913 vsize=584456 CPUtime=0 cores=0-7
/proc/22024/task/22043/stat : 22043 (python) S 21913 21913 21696 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 548481997 598482944 7195 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604440279245120 0 0 -1 1 0 0 0
[pid=22028] ppid=21913 vsize=594712 CPUtime=0.93 cores=0-7
/proc/22028/stat : 22028 (python) S 21913 21913 21696 0 -1 4202560 1196 0 0 0 47 46 0 0 18 0 2 0 548463159 608985088 7194 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/22028/statm: 148678 7194 400 364 0 84524 0
[pid=22030] ppid=22028 vsize=268420 CPUtime=403.65 cores=0-7
/proc/22030/stat : 22030 (hybridGM3) R 22028 22030 22030 0 -1 4202496 5825 0 0 0 40364 1 0 0 25 0 1 0 548463161 274862080 5543 33554432000 134512640 135204385 4288716304 18446744073709551615 134538541 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22030/statm: 67105 5543 63 169 0 66935 0
[pid=22028/tid=22045] ppid=21913 vsize=594712 CPUtime=0 cores=0-7
/proc/22028/task/22045/stat : 22045 (python) S 21913 21913 21696 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 548482711 608985088 7194 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604446568973312 0 0 -1 1 0 0 0
[pid=22034] ppid=21913 vsize=604968 CPUtime=0.21 cores=0-7
/proc/22034/stat : 22034 (python) S 21913 21913 21696 0 -1 4202560 1176 0 0 0 12 9 0 0 19 0 2 0 548471387 619487232 7280 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/22034/statm: 151242 7280 400 364 0 87085 0
[pid=22036] ppid=22034 vsize=335996 CPUtime=99.98 cores=0-7
/proc/22036/stat : 22036 (iPAWS) T 22034 22036 22036 0 -1 4202496 1828 0 0 0 9998 0 0 0 25 0 1 0 548471389 344059904 1546 33554432000 134512640 135114423 4290349168 18446744073709551615 134516639 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22036/statm: 83999 1546 59 147 0 83851 0
[pid=22034/tid=22039] ppid=21913 vsize=604968 CPUtime=0 cores=0-7
/proc/22034/task/22039/stat : 22039 (python) S 21913 21913 21696 0 -1 4202560 83 0 0 0 0 0 0 0 19 0 2 0 548481413 619487232 7280 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604447009337664 0 0 -1 1 0 0 0
[pid=22040] ppid=21913 vsize=615224 CPUtime=0.22 cores=0-7
/proc/22040/stat : 22040 (python) S 21913 21913 21696 0 -1 4202560 1211 0 0 0 12 10 0 0 18 0 2 0 548481986 629989376 7185 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/22040/statm: 153806 7185 400 364 0 89646 0
[pid=22042] ppid=22040 vsize=1018996 CPUtime=99.5 cores=0-7
/proc/22042/stat : 22042 (gnovelty+2) T 22040 22042 22042 0 -1 4202496 982 0 0 0 9950 0 0 0 25 0 1 0 548481986 1043451904 697 33554432000 134512640 135663704 4293663328 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22042/statm: 254749 697 113 282 0 254465 0
[pid=22040/tid=22048] ppid=21913 vsize=615224 CPUtime=0 cores=0-7
/proc/22040/task/22048/stat : 22048 (python) S 21913 21913 21696 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 548492018 629989376 7185 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604449608582144 0 0 -1 3 0 0 0
[pid=22049] ppid=21913 vsize=625480 CPUtime=0.7 cores=0-7
/proc/22049/stat : 22049 (python) S 21913 21913 21696 0 -1 4202560 1012 0 0 0 33 37 0 0 18 0 1 0 548492023 640491520 7269 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401347 0 0 17 7 0 0 0
/proc/22049/statm: 156370 7269 372 364 0 92207 0
[pid=22051] ppid=22049 vsize=459768 CPUtime=291.16 cores=0-7
/proc/22051/stat : 22051 (TNM) R 22049 22051 22051 0 -1 4202496 1935 0 0 0 29116 0 0 0 25 0 1 0 548492025 470802432 1653 33554432000 134512640 135008748 4286981792 18446744073709551615 134529422 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/22051/statm: 114942 1653 46 122 0 113842 0
[pid=22052] ppid=21913 vsize=635736 CPUtime=0.23 cores=0-7
/proc/22052/stat : 22052 (python) S 21913 21913 21696 0 -1 4202560 1244 0 0 0 12 11 0 0 19 0 2 0 548492452 650993664 7280 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/22052/statm: 158934 7280 407 364 0 94768 0
[pid=22054] ppid=22052 vsize=251288 CPUtime=98.62 cores=0-7
/proc/22054/stat : 22054 (FH) T 22052 22054 22054 0 -1 4202496 1966 0 0 0 9862 0 0 0 25 0 1 0 548492452 257318912 1682 33554432000 134512640 134936988 4293633216 18446744073709551615 134553236 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/22054/statm: 62822 1682 41 104 0 62326 0
[pid=22052/tid=22058] ppid=21913 vsize=635736 CPUtime=0 cores=0-7
/proc/22052/task/22058/stat : 22058 (python) S 21913 21913 21696 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 548502376 650993664 7280 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604443337329472 0 0 -1 4 0 0 0
[pid=22059] ppid=21913 vsize=645992 CPUtime=0.46 cores=0-7
/proc/22059/stat : 22059 (python) S 21913 21913 21696 0 -1 4202560 1057 0 0 0 22 24 0 0 18 0 1 0 548502387 661495808 7232 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 6150069911453401346 0 0 17 6 0 0 0
/proc/22059/statm: 161498 7232 378 364 0 97329 0
[pid=22061] ppid=22059 vsize=421364 CPUtime=195.65 cores=0-7
/proc/22061/stat : 22061 (NCVWr) R 22059 22061 22061 0 -1 4202496 1994 0 0 0 19565 0 0 0 25 0 1 0 548502387 431476736 1710 33554432000 134512640 135113558 4287165584 18446744073709551615 134531797 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22061/statm: 105341 1710 58 147 0 104216 0
[pid=22064] ppid=21913 vsize=656248 CPUtime=0.24 cores=0-7
/proc/22064/stat : 22064 (python) S 21913 21913 21696 0 -1 4202560 1266 0 0 0 12 12 0 0 19 0 2 0 548511405 671997952 7312 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512518603 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/22064/statm: 164062 7312 406 364 0 99890 0
[pid=22066] ppid=22064 vsize=335996 CPUtime=101.57 cores=0-7
/proc/22066/stat : 22066 (iPAWS) T 22064 22066 22066 0 -1 4202496 1834 0 0 0 10156 1 0 0 25 0 1 0 548511406 344059904 1546 33554432000 134512640 135114423 4291402144 18446744073709551615 134516967 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/22066/statm: 83999 1546 59 147 0 83851 0
[pid=22064/tid=22073] ppid=21913 vsize=656248 CPUtime=0 cores=0-7
/proc/22064/task/22073/stat : 22073 (python) S 21913 21913 21696 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 548522029 671997952 7312 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 514 18446604443337328576 0 0 -1 3 0 0 0
[pid=22070] ppid=21913 vsize=666504 CPUtime=0.01 cores=0-7
/proc/22070/stat : 22070 (python) S 21913 21913 21696 0 -1 4202560 1073 0 0 0 1 0 0 0 18 0 1 0 548521318 682500096 7244 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 15457858057337274626 0 0 17 4 0 0 0
/proc/22070/statm: 166626 7244 378 364 0 102451 0
[pid=22072] ppid=22070 vsize=268424 CPUtime=7.69 cores=0-7
/proc/22072/stat : 22072 (hybridGM3) R 22070 22072 22072 0 -1 4202496 5834 0 0 0 769 0 0 0 25 0 1 0 548521319 274866176 5543 33554432000 134512640 135204385 4287482944 18446744073709551615 134537704 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22072/statm: 67106 5543 63 169 0 66936 0
[pid=22074] ppid=21913 vsize=676760 CPUtime=0 cores=0-7
/proc/22074/stat : 22074 (python) S 21913 21913 21696 0 -1 4202560 918 0 0 0 0 0 0 0 20 0 1 0 548522040 693002240 7343 33554432000 4194304 5683644 140737202947120 18446744073709551615 254500712006 0 0 16781312 514 15817188627777060863 0 0 17 6 0 0 0
/proc/22074/statm: 169190 7343 346 364 0 105012 0
[pid=22076] ppid=22074 vsize=453824 CPUtime=0.48 cores=0-7
/proc/22076/stat : 22076 (TNM) R 22074 22076 22076 0 -1 4202496 1228 0 0 0 48 0 0 0 23 0 1 0 548522041 464715776 934 33554432000 134512640 135008748 4288777840 18446744073709551615 134523375 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/22076/statm: 113456 934 45 122 0 112356 0
[pid=21913/tid=21920] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21920/stat : 21920 (python) S 21911 21913 21696 0 -1 4202560 25 932 0 0 0 0 0 0 19 0 34 0 548402966 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21923] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21923/stat : 21923 (python) S 21911 21913 21696 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 34 0 548402970 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 3 0 0 0
[pid=21913/tid=21926] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21926/stat : 21926 (python) S 21911 21913 21696 0 -1 4202560 109 932 0 0 0 0 0 0 18 0 34 0 548402974 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21929] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21929/stat : 21929 (python) S 21911 21913 21696 0 -1 4202560 36 932 0 0 0 0 0 0 15 0 34 0 548402977 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 5 0 0 0
[pid=21913/tid=21932] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21932/stat : 21932 (python) S 21911 21913 21696 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 34 0 548402981 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21935] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21935/stat : 21935 (python) S 21911 21913 21696 0 -1 4202560 32 932 0 0 0 0 0 0 21 0 34 0 548402985 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 7 0 0 0
[pid=21913/tid=21938] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21938/stat : 21938 (python) S 21911 21913 21696 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 34 0 548402989 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=21941] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21941/stat : 21941 (python) S 21911 21913 21696 0 -1 4202560 87 932 0 0 0 0 0 0 18 0 34 0 548402993 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=21948] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21948/stat : 21948 (python) S 21911 21913 21696 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 34 0 548412897 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=21953] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21953/stat : 21953 (python) S 21911 21913 21696 0 -1 4202560 50 932 0 0 0 0 0 0 15 0 34 0 548412993 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=21957] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21957/stat : 21957 (python) S 21911 21913 21696 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 34 0 548412998 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 0 0 0 0
[pid=21913/tid=21961] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21961/stat : 21961 (python) S 21911 21913 21696 0 -1 4202560 31 932 0 0 0 0 0 0 22 0 34 0 548413003 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 7 0 0 0
[pid=21913/tid=21965] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21965/stat : 21965 (python) S 21911 21913 21696 0 -1 4202560 55 932 0 0 0 0 0 0 15 0 34 0 548413009 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=21970] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21970/stat : 21970 (python) S 21911 21913 21696 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 34 0 548413015 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 4 0 0 0
[pid=21913/tid=21973] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21973/stat : 21973 (python) S 21911 21913 21696 0 -1 4202560 33 932 0 0 0 0 0 0 25 0 34 0 548413021 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=21976] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21976/stat : 21976 (python) S 21911 21913 21696 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 34 0 548413027 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=21983] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21983/stat : 21983 (python) S 21911 21913 21696 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 34 0 548422923 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=21987] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21987/stat : 21987 (python) S 21911 21913 21696 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 34 0 548422938 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=21997] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/21997/stat : 21997 (python) S 21911 21913 21696 0 -1 4202560 42 932 0 0 0 0 0 0 19 0 34 0 548432951 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 3 0 0 0
[pid=21913/tid=22004] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22004/stat : 22004 (python) S 21911 21913 21696 0 -1 4202560 50 932 0 0 0 0 0 0 18 0 34 0 548442201 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=22007] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22007/stat : 22007 (python) S 21911 21913 21696 0 -1 4202560 51 932 0 0 0 0 0 0 18 0 34 0 548442378 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=22010] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22010/stat : 22010 (python) S 21911 21913 21696 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 34 0 548442411 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=22018] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22018/stat : 22018 (python) S 21911 21913 21696 0 -1 4202560 37 932 0 0 0 0 0 0 20 0 34 0 548452626 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=22025] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22025/stat : 22025 (python) S 21911 21913 21696 0 -1 4202560 45 932 0 0 0 0 0 0 18 0 34 0 548462442 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=22029] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22029/stat : 22029 (python) S 21911 21913 21696 0 -1 4202560 49 932 0 0 0 0 0 0 18 0 34 0 548463160 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=22035] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22035/stat : 22035 (python) S 21911 21913 21696 0 -1 4202560 30 932 0 0 0 0 0 0 19 0 34 0 548471387 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=22041] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22041/stat : 22041 (python) S 21911 21913 21696 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 34 0 548481986 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=22050] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22050/stat : 22050 (python) S 21911 21913 21696 0 -1 4202560 35 932 0 0 0 0 0 0 19 0 34 0 548492023 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 7 0 0 0
[pid=21913/tid=22053] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22053/stat : 22053 (python) S 21911 21913 21696 0 -1 4202560 34 932 0 0 0 0 0 0 20 0 34 0 548492452 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=22060] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22060/stat : 22060 (python) S 21911 21913 21696 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 34 0 548502387 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=22065] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22065/stat : 22065 (python) S 21911 21913 21696 0 -1 4202560 36 932 0 0 0 0 0 0 18 0 34 0 548511405 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 1 0 0 0
[pid=21913/tid=22071] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22071/stat : 22071 (python) S 21911 21913 21696 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 34 0 548521319 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
[pid=21913/tid=22075] ppid=21911 vsize=687004 CPUtime=0 cores=0-7
/proc/21913/task/22075/stat : 22075 (python) S 21911 21913 21696 0 -1 4202560 30 932 0 0 0 0 0 0 19 0 34 0 548522041 703492096 8943 33554432000 4194304 5683644 140737202947120 18446744073709551615 254512515505 0 0 16781312 2 18446604445180300160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9490.97
Current children cumulated vsize (KiB) 32811000

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21913 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=769970
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=256960
# CPU time returned by wait4() is 7.02693
# while last known CPU time is 9490.97
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1193.61
CPU time (s): 9490.97
CPU user time (s): 9480.47
CPU system time (s): 10.5
CPU usage (%): 795.151
Max. virtual memory (cumulated for all children) (KiB): 32811000

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.76997
system time used= 0.25696
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 75928
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3244
involuntary context switches= 129

runsolver used 11.7462 second user time and 27.0089 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-02 22:27:40
IDJOB=3321833
IDBENCH=82611
IDSOLVER=1712
FILE ID=node149/3321833-1304368060
RUNJOBID= node149-1304366464-21710
PBS_JOBID= 13181725
Free space on /tmp= 73556 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S969405384-096-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321833-1304368060/watcher-3321833-1304368060 -o /tmp/evaluation-result-3321833-1304368060/solver-3321833-1304368060 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321833-1304368060.cnf -seed 1132285276 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6e345981a96012731da9bd2ce5420289
RANDOM SEED=1132285276

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23619652 kB
Buffers:          7188 kB
Cached:         174456 kB
SwapCached:      27552 kB
Active:         144660 kB
Inactive:      9012064 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23619652 kB
SwapTotal:    67111528 kB
SwapFree:     54880832 kB
Dirty:           32696 kB
Writeback:          20 kB
AnonPages:     8958588 kB
Mapped:          11140 kB
Slab:            56092 kB
PageTables:      54084 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 43612404 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73524 MiB
End job on node149 at 2011-05-02 22:47:36