Trace number 3321871

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10720.9 1529.1

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S1158419275-045-UNKNOWN.cnf
MD5SUMba96eb51c814e4238dd0a7b33e8bab2d
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.67	c INFO: solving HOME/instance-3321871-1304368840.cnf
0.37/0.67	c INFO: computing task features
0.54/0.84	c INFO: computed variable-clause graph statistics
0.54/0.85	c INFO: computed clause balance statistics
1.45/1.72	c INFO: computed variable balance statistics
1.75/2.07	c INFO: computed small-clause counts
1.75/2.07	c INFO: computed Horn-clause counts
1.75/2.10	c INFO: computed variable graph statistics
1.75/2.10	c INFO: collected features for HOME/instance-3321871-1304368840.cnf in 1.43 s
1.85/2.14	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.37)
1.85/2.17	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.95/2.21	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
1.95/2.25	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
1.95/2.28	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.04/2.32	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.04/2.36	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.15/2.40	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
702.06/102.42	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.02)
702.06/102.46	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
702.62/102.51	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
702.62/102.58	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
703.00/102.63	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
703.00/102.69	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.01)
1036.95/150.47	c INFO: running hybridGM3@0 for 194 with 39850 remaining (b = 0.03)
1039.72/150.86	c INFO: running hybridGM3@0 for 194 with 39849 remaining (b = 0.02)
1405.58/202.74	c INFO: running TNM@0 for 1552 with 39797 remaining (b = 0.19)
1494.69/214.92	c INFO: running FH@0 for 97 with 39785 remaining (b = 0.01)
1579.78/227.17	c INFO: running adaptg2wsat2009++@0 for 97 with 39773 remaining (b = 0.01)
1656.04/237.77	c INFO: running adaptg2wsat2009++@0 for 97 with 39762 remaining (b = 0.01)
2083.45/299.01	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2119.73/304.21	c INFO: running hybridGM3@99 for 97 with 39696 remaining (b = 0.01)
2334.46/335.01	c INFO: running adaptg2wsat2009++@0 for 97 with 39665 remaining (b = 0.01)
2386.08/342.44	c INFO: running adaptg2wsat2009++@100 for 97 with 39658 remaining (b = 0.01)
2496.94/358.38	c INFO: running hybridGM3@97 for 97 with 39642 remaining (b = 0.01)
2572.96/369.26	c INFO: running hybridGM3@0 for 194 with 39631 remaining (b = 0.02)
2789.08/400.25	c INFO: running hybridGM3@295 for 97 with 39600 remaining (b = 0.01)
2909.01/417.48	c INFO: running TNM@0 for 1552 with 39583 remaining (b = 0.15)
3063.79/439.69	c INFO: running adaptg2wsat2009++@100 for 97 with 39561 remaining (b = 0.01)
3123.04/448.17	c INFO: running hybridGM3@98 for 97 with 39552 remaining (b = 0.01)
3161.41/453.63	c INFO: running gnovelty+2@0 for 97 with 39547 remaining (b = 0.01)
3305.71/474.33	c INFO: running hybridGM3@0 for 194 with 39526 remaining (b = 0.02)
3458.27/495.49	c INFO: running hybridGM3@393 for 97 with 39505 remaining (b = 0.01)
3768.32/536.99	c INFO: running FH@0 for 291 with 39463 remaining (b = 0.03)
3895.35/553.95	c INFO: running iPAWS@0 for 97 with 39446 remaining (b = 0.01)
3951.40/561.46	c INFO: running hybridGM3@193 for 97 with 39439 remaining (b = 0.01)
4155.70/590.74	c INFO: running adaptg2wsat2009++@298 for 291 with 39409 remaining (b = 0.02)
4602.20/653.24	c INFO: running FH@99 for 291 with 39347 remaining (b = 0.02)
4663.71/662.04	c INFO: running hybridGM3@100 for 97 with 39338 remaining (b = 0.01)
4766.92/676.89	c INFO: running hybridGM3@95 for 97 with 39323 remaining (b = 0.01)
5164.23/733.89	c INFO: running hybridGM3@0 for 194 with 39266 remaining (b = 0.02)
5472.91/778.17	c INFO: running hybridGM3@190 for 97 with 39222 remaining (b = 0.01)
5803.95/825.66	c INFO: running hybridGM3@0 for 194 with 39175 remaining (b = 0.01)
5913.98/841.46	c INFO: running hybridGM3@296 for 194 with 39159 remaining (b = 0.02)
6226.57/886.38	c INFO: running TNM@0 for 1552 with 39114 remaining (b = 0.11)
6391.17/909.50	c INFO: running adaptg2wsat2009++@397 for 194 with 39091 remaining (b = 0.02)
6712.78/954.61	c INFO: running hybridGM3@478 for 97 with 39046 remaining (b = 0.01)
7105.66/1011.04	c INFO: running FH@296 for 97 with 38989 remaining (b = 0.01)
7309.06/1040.23	c INFO: running iPAWS@0 for 97 with 38960 remaining (b = 0.01)
7383.60/1050.94	c INFO: running adaptg2wsat2009++@295 for 291 with 38949 remaining (b = 0.02)
7724.89/1099.98	c INFO: running FH@100 for 291 with 38900 remaining (b = 0.02)
7894.81/1124.35	c INFO: running NCVWr@0 for 485 with 38876 remaining (b = 0.03)
7955.45/1133.02	c INFO: running gnovelty+2@0 for 97 with 38867 remaining (b = 0.01)
8007.60/1140.52	c INFO: running hybridGM3@97 for 97 with 38860 remaining (b = 0.01)
8685.15/1237.82	c INFO: running hybridGM3@99 for 97 with 38762 remaining (b = 0.01)
8898.26/1268.49	c INFO: running iPAWS@0 for 97 with 38732 remaining (b = 0.01)
9596.87/1368.79	c INFO: running FH@0 for 97 with 38631 remaining (b = 0.01)
9651.81/1376.65	c INFO: running adaptg2wsat2009++@393 for 194 with 38624 remaining (b = 0.01)
9867.38/1407.68	c INFO: running hybridGM3@0 for 194 with 38593 remaining (b = 0.01)
9906.35/1413.27	c INFO: running adaptg2wsat2009++@100 for 97 with 38587 remaining (b = 0.01)
10295.09/1469.11	c INFO: running FH@293 for 97 with 38531 remaining (b = 0.01)
10718.69/1528.64	c INFO: running NCVWr@0 for 485 with 38472 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321871-1304368840/watcher-3321871-1304368840 -o /tmp/evaluation-result-3321871-1304368840/solver-3321871-1304368840 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321871-1304368840.cnf -seed 358744891 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.50 9.13 8.15 2/232 31830
/proc/meminfo: memFree=16379392/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=15380 CPUtime=0 cores=0-7
/proc/31830/stat : 31830 (python) R 31828 31830 31414 0 -1 4202496 808 0 0 0 0 0 0 0 22 0 1 0 548483669 15749120 693 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473967248 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31830/statm: 3845 694 333 364 0 332 0

[startup+0.0170289 s]
/proc/loadavg: 9.50 9.13 8.15 2/232 31830
/proc/meminfo: memFree=16379392/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=16236 CPUtime=0 cores=0-7
/proc/31830/stat : 31830 (python) R 31828 31830 31414 0 -1 4202496 997 0 0 0 0 0 0 0 22 0 1 0 548483669 16625664 869 33554432000 4194304 5683644 140736996248048 18446744073709551615 4887611 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31830/statm: 4059 869 368 364 0 546 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16236

[startup+0.10108 s]
/proc/loadavg: 9.50 9.13 8.15 2/232 31830
/proc/meminfo: memFree=16379392/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=89768 CPUtime=0.06 cores=0-7
/proc/31830/stat : 31830 (python) R 31828 31830 31414 0 -1 4202496 2641 0 0 0 4 2 0 0 17 0 1 0 548483669 91922432 2356 33554432000 4194304 5683644 140736996248048 18446744073709551615 274468997920 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31830/statm: 22442 2359 721 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89768

[startup+0.300976 s]
/proc/loadavg: 9.50 9.13 8.15 2/232 31830
/proc/meminfo: memFree=16379392/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=135748 CPUtime=0.19 cores=0-7
/proc/31830/stat : 31830 (python) S 31828 31830 31414 0 -1 4202496 5964 933 1 0 14 5 0 0 18 0 1 0 548483669 139005952 4151 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473963525 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/31830/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700904 s]
/proc/loadavg: 9.50 9.13 8.15 2/232 31830
/proc/meminfo: memFree=16379392/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=279840 CPUtime=0.44 cores=0-7
/proc/31830/stat : 31830 (python) R 31828 31830 31414 0 -1 4202496 9624 933 1 0 33 11 0 0 17 0 1 0 548483669 286556160 7305 33554432000 4194304 5683644 140736996248048 18446744073709551615 4539725 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31830/statm: 69960 7305 1761 364 0 5884 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 279840

[startup+1.50082 s]
/proc/loadavg: 9.50 9.13 8.15 3/233 31835
/proc/meminfo: memFree=16351360/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=285676 CPUtime=1.25 cores=0-7
/proc/31830/stat : 31830 (python) R 31828 31830 31414 0 -1 4202496 12376 933 1 0 113 12 0 0 18 0 1 0 548483669 292532224 8804 33554432000 4194304 5683644 140736996248048 18446744073709551615 4567031 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31830/statm: 71419 8804 1826 364 0 7343 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 285676

[startup+3.10048 s]
/proc/loadavg: 9.50 9.13 8.15 3/233 31835
/proc/meminfo: memFree=16350988/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=427780 CPUtime=2.15 cores=0-7
/proc/31830/stat : 31830 (python) S 31828 31830 31414 0 -1 4202496 18368 933 1 0 201 14 0 0 22 0 9 0 548483669 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31830/statm: 106945 7688 1891 364 0 42842 0
Current children cumulated CPU time (s) 2.15
Current children cumulated vsize (KiB) 427780
heavy processes:

[startup+6.30092 s]
/proc/loadavg: 9.46 9.13 8.16 10/257 31859
/proc/meminfo: memFree=16297856/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=427780 CPUtime=2.15 cores=0-7
/proc/31830/stat : 31830 (python) S 31828 31830 31414 0 -1 4202496 18368 933 1 0 201 14 0 0 22 0 9 0 548483669 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31830/statm: 106945 7688 1891 364 0 42842 0
[pid=31836] ppid=31830 vsize=280692 CPUtime=0 cores=0-7
/proc/31836/stat : 31836 (python) S 31830 31830 31414 0 -1 4202560 885 0 0 0 0 0 0 0 18 0 1 0 548483883 287428608 5984 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987599 0 0 16781312 514 4016810649676906754 0 0 17 0 0 0 0
/proc/31836/statm: 70173 5984 378 364 0 6091 0
[pid=31838] ppid=31836 vsize=1019708 CPUtime=4.11 cores=0-7
/proc/31838/stat : 31838 (gnovelty+2) R 31836 31838 31838 0 -1 4202496 956 0 0 0 411 0 0 0 25 0 1 0 548483884 1044180992 689 33554432000 134512640 135663704 4294800560 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31838/statm: 254927 689 113 282 0 254643 0
[pid=31839] ppid=31830 vsize=291016 CPUtime=0 cores=0-7
/proc/31839/stat : 31839 (python) S 31830 31830 31414 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 548483887 298000384 5982 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 6189749916005269761 0 0 17 1 0 0 0
/proc/31839/statm: 72754 5982 372 364 0 8669 0
[pid=31841] ppid=31839 vsize=1019708 CPUtime=4.11 cores=0-7
/proc/31841/stat : 31841 (gnovelty+2) R 31839 31841 31841 0 -1 4202496 954 0 0 0 411 0 0 0 25 0 1 0 548483887 1044180992 690 33554432000 134512640 135663704 4288405472 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31841/statm: 254927 690 113 282 0 254643 0
[pid=31842] ppid=31830 vsize=301204 CPUtime=0 cores=0-7
/proc/31842/stat : 31842 (python) S 31830 31830 31414 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 548483891 308432896 6002 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4596386593299726593 0 0 17 1 0 0 0
/proc/31842/statm: 75301 6002 371 364 0 11213 0
[pid=31844] ppid=31842 vsize=420220 CPUtime=4.07 cores=0-7
/proc/31844/stat : 31844 (adaptg2wsat2009) R 31842 31844 31844 0 -1 4202496 1663 0 0 0 407 0 0 0 25 0 1 0 548483891 430305280 1399 33554432000 134512640 135107411 4293839104 18446744073709551615 134531731 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31844/statm: 105055 1399 59 146 0 103931 0
[pid=31845] ppid=31830 vsize=376512 CPUtime=0 cores=0-7
/proc/31845/stat : 31845 (python) S 31830 31830 31414 0 -1 4202560 784 0 0 0 0 0 0 0 18 0 1 0 548483894 385548288 6178 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 579179024220127489 0 0 17 1 0 0 0
/proc/31845/statm: 94128 6178 371 364 0 30037 0
[pid=31847] ppid=31845 vsize=420220 CPUtime=4.03 cores=0-7
/proc/31847/stat : 31847 (adaptg2wsat2009) R 31845 31847 31847 0 -1 4202496 1653 0 0 0 403 0 0 0 25 0 1 0 548483895 430305280 1400 33554432000 134512640 135107411 4292069120 18446744073709551615 134548390 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31847/statm: 105055 1400 59 146 0 103931 0
[pid=31848] ppid=31830 vsize=386772 CPUtime=0 cores=0-7
/proc/31848/stat : 31848 (python) R 31830 31830 31414 0 -1 4202560 781 0 0 0 0 0 0 0 18 0 1 0 548483898 396054528 6146 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473967419 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/31848/statm: 96692 6146 365 364 0 32598 0
[pid=31850] ppid=31848 vsize=419820 CPUtime=3.97 cores=0-7
/proc/31850/stat : 31850 (adaptg2wsat2009) R 31848 31850 31850 0 -1 4202496 1431 0 0 0 397 0 0 0 25 0 1 0 548483899 429895680 1172 33554432000 134512640 135107411 4287797408 18446744073709551615 134523302 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31850/statm: 104955 1172 49 146 0 103831 0
[pid=31851] ppid=31830 vsize=397024 CPUtime=0 cores=0-7
/proc/31851/stat : 31851 (python) S 31830 31830 31414 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 548483902 406552576 6100 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4174401727140692227 0 0 17 1 0 0 0
/proc/31851/statm: 99256 6100 348 364 0 35159 0
[pid=31853] ppid=31851 vsize=1019708 CPUtime=2.09 cores=0-7
/proc/31853/stat : 31853 (gnovelty+2) R 31851 31853 31853 0 -1 4202496 947 0 0 0 209 0 0 0 25 0 1 0 548483904 1044180992 690 33554432000 134512640 135663704 4293637488 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31853/statm: 254927 690 113 282 0 254643 0
[pid=31854] ppid=31830 vsize=407280 CPUtime=0 cores=0-7
/proc/31854/stat : 31854 (python) S 31830 31830 31414 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 548483906 417054720 6232 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 6966708812656902401 0 0 17 6 0 0 0
/proc/31854/statm: 101820 6232 348 364 0 37720 0
[pid=31858] ppid=31854 vsize=247956 CPUtime=3.88 cores=0-7
/proc/31858/stat : 31858 (FH) R 31854 31858 31858 0 -1 4202496 1244 0 0 0 387 1 0 0 25 0 1 0 548483910 253906944 986 33554432000 134512640 134936988 4290415472 18446744073709551615 134523447 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31858/statm: 61989 986 37 104 0 61493 0
[pid=31856] ppid=31830 vsize=417536 CPUtime=0 cores=0-7
/proc/31856/stat : 31856 (python) S 31830 31830 31414 0 -1 4202560 776 0 0 0 0 0 0 0 18 0 1 0 548483910 427556864 6147 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 15935102453762982145 0 0 17 1 0 0 0
/proc/31856/statm: 104384 6147 354 364 0 40281 0
[pid=31859] ppid=31856 vsize=419820 CPUtime=1.85 cores=0-7
/proc/31859/stat : 31859 (adaptg2wsat2009) R 31856 31859 31859 0 -1 4202496 1437 0 0 0 185 0 0 0 25 0 1 0 548483916 429895680 1172 33554432000 134512640 135107411 4289383488 18446744073709551615 134523452 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31859/statm: 104955 1172 49 146 0 103831 0
[pid=31830/tid=31837] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31837/stat : 31837 (python) S 31828 31830 31414 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 9 0 548483884 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 0 0 0 0
[pid=31830/tid=31840] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31840/stat : 31840 (python) S 31828 31830 31414 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 548483887 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 4 0 0 0
[pid=31830/tid=31843] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31843/stat : 31843 (python) S 31828 31830 31414 0 -1 4202560 21 933 0 0 0 0 0 0 18 0 9 0 548483891 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 3 0 0 0
[pid=31830/tid=31846] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31846/stat : 31846 (python) S 31828 31830 31414 0 -1 4202560 93 933 0 0 0 0 0 0 20 0 9 0 548483895 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 0 0 0 0
[pid=31830/tid=31849] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31849/stat : 31849 (python) S 31828 31830 31414 0 -1 4202560 33 933 0 0 0 0 0 0 21 0 9 0 548483898 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 7 0 0 0
[pid=31830/tid=31852] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31852/stat : 31852 (python) S 31828 31830 31414 0 -1 4202560 30 933 0 0 0 0 0 0 19 0 9 0 548483902 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 1 0 0 0
[pid=31830/tid=31855] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31855/stat : 31855 (python) S 31828 31830 31414 0 -1 4202560 44 933 0 0 0 0 0 0 21 0 9 0 548483906 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31857] ppid=31828 vsize=427780 CPUtime=0 cores=0-7
/proc/31830/task/31857/stat : 31857 (python) S 31828 31830 31414 0 -1 4202560 71 933 0 0 0 0 0 0 23 0 9 0 548483910 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 30.26
Current children cumulated vsize (KiB) 8272976

[startup+12.7018 s]
/proc/loadavg: 9.42 9.13 8.16 10/257 31859
/proc/meminfo: memFree=16292904/32950928 swapFree=67111524/67111528
[pid=31830] ppid=31828 vsize=427780 CPUtime=2.15 cores=0-7
/proc/31830/stat : 31830 (python) S 31828 31830 31414 0 -1 4202496 18368 933 1 0 201 14 0 0 22 0 9 0 548483669 438046720 7688 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/31830/statm: 106945 7688 1891 364 0 42842 0
[pid=31836] ppid=31830 vsize=280692 CPUtime=0.02 cores=0-7
/proc/31836/stat : 31836 (python) S 31830 31830 31414 0 -1 4202560 889 0 0 0 1 1 0 0 18 0 1 0 548483883 287428608 5984 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987599 0 0 16781312 514 4811550844077965570 0 0 17 0 0 0 0
/proc/31836/statm: 70173 5984 378 364 0 6091 0
[pid=31838] ppid=31836 vsize=1019708 CPUtime=7.31 cores=0-7
/proc/31838/stat : 31838 (gnovelty+2) R 31836 31838 31838 0 -1 4202496 956 0 0 0 731 0 0 0 25 0 1 0 548483884 1044180992 689 33554432000 134512640 135663704 4294800560 18446744073709551615 134524697 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31838/statm: 254927 689 113 282 0 254643 0
[pid=31839] ppid=31830 vsize=291016 CPUtime=0.02 cores=0-7
/proc/31839/stat : 31839 (python) S 31830 31830 31414 0 -1 4202560 907 0 0 0 1 1 0 0 18 0 1 0 548483887 298000384 5982 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 1 0 0 0
/proc/31839/statm: 72754 5982 372 364 0 8669 0
[pid=31841] ppid=31839 vsize=1019708 CPUtime=10.51 cores=0-7
/proc/31841/stat : 31841 (gnovelty+2) R 31839 31841 31841 0 -1 4202496 954 0 0 0 1051 0 0 0 25 0 1 0 548483887 1044180992 690 33554432000 134512640 135663704 4288405472 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31841/statm: 254927 690 113 282 0 254643 0
[pid=31842] ppid=31830 vsize=301204 CPUtime=0.02 cores=0-7
/proc/31842/stat : 31842 (python) S 31830 31830 31414 0 -1 4202560 904 0 0 0 1 1 0 0 18 0 1 0 548483891 308432896 6003 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 1 0 0 0
/proc/31842/statm: 75301 6003 372 364 0 11213 0
[pid=31844] ppid=31842 vsize=420220 CPUtime=10.47 cores=0-7
/proc/31844/stat : 31844 (adaptg2wsat2009) R 31842 31844 31844 0 -1 4202496 1663 0 0 0 1047 0 0 0 25 0 1 0 548483891 430305280 1399 33554432000 134512640 135107411 4293839104 18446744073709551615 134532318 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31844/statm: 105055 1399 59 146 0 103931 0
[pid=31845] ppid=31830 vsize=376512 CPUtime=0.01 cores=0-7
/proc/31845/stat : 31845 (python) S 31830 31830 31414 0 -1 4202560 788 0 0 0 1 0 0 0 18 0 1 0 548483894 385548288 6178 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 1 0 0 0
/proc/31845/statm: 94128 6178 371 364 0 30037 0
[pid=31847] ppid=31845 vsize=420220 CPUtime=10.42 cores=0-7
/proc/31847/stat : 31847 (adaptg2wsat2009) R 31845 31847 31847 0 -1 4202496 1653 0 0 0 1042 0 0 0 25 0 1 0 548483895 430305280 1400 33554432000 134512640 135107411 4292069120 18446744073709551615 134531856 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31847/statm: 105055 1400 59 146 0 103931 0
[pid=31848] ppid=31830 vsize=386768 CPUtime=0.01 cores=0-7
/proc/31848/stat : 31848 (python) S 31830 31830 31414 0 -1 4202560 798 0 0 0 0 1 0 0 18 0 1 0 548483898 396050432 6152 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 1 0 0 0
/proc/31848/statm: 96692 6152 371 364 0 32598 0
[pid=31850] ppid=31848 vsize=420220 CPUtime=10.31 cores=0-7
/proc/31850/stat : 31850 (adaptg2wsat2009) R 31848 31850 31850 0 -1 4202496 1658 0 0 0 1031 0 0 0 25 0 1 0 548483899 430305280 1399 33554432000 134512640 135107411 4287797408 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31850/statm: 105055 1399 59 146 0 103931 0
[pid=31851] ppid=31830 vsize=397024 CPUtime=0.01 cores=0-7
/proc/31851/stat : 31851 (python) S 31830 31830 31414 0 -1 4202560 807 0 0 0 0 1 0 0 18 0 1 0 548483902 406552576 6123 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965571 0 0 17 1 0 0 0
/proc/31851/statm: 99256 6123 371 364 0 35159 0
[pid=31853] ppid=31851 vsize=1019708 CPUtime=8.41 cores=0-7
/proc/31853/stat : 31853 (gnovelty+2) R 31851 31853 31853 0 -1 4202496 947 0 0 0 841 0 0 0 25 0 1 0 548483904 1044180992 690 33554432000 134512640 135663704 4293637488 18446744073709551615 134525187 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31853/statm: 254927 690 113 282 0 254643 0
[pid=31854] ppid=31830 vsize=407280 CPUtime=0.01 cores=0-7
/proc/31854/stat : 31854 (python) S 31830 31830 31414 0 -1 4202560 815 0 0 0 0 1 0 0 18 0 1 0 548483906 417054720 6255 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 6 0 0 0

################
# More data... #
################

[pid=31929] ppid=31830 vsize=561120 CPUtime=1.17 cores=0-7
/proc/31929/stat : 31929 (python) S 31830 31830 31414 0 -1 4202560 1175 0 0 0 59 58 0 0 18 0 2 0 548531103 574586880 6533 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/31929/statm: 140280 6533 407 364 0 76135 0
[pid=31931] ppid=31929 vsize=268420 CPUtime=487.92 cores=0-7
/proc/31931/stat : 31931 (hybridGM3) T 31929 31931 31931 0 -1 4202496 5406 0 0 0 48792 0 0 0 25 0 1 0 548531103 274862080 5126 33554432000 134512640 135204385 4294657040 18446744073709551615 134537939 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/31931/statm: 67105 5126 63 169 0 66935 0
[pid=31929/tid=31943] ppid=31830 vsize=561120 CPUtime=0 cores=0-7
/proc/31929/task/31943/stat : 31943 (python) S 31830 31830 31414 0 -1 4202560 81 0 0 0 0 0 0 0 18 0 2 0 548551350 574586880 6533 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604449906485376 0 0 -1 0 0 0 0
[pid=31935] ppid=31830 vsize=571376 CPUtime=0.2 cores=0-7
/proc/31935/stat : 31935 (python) S 31830 31830 31414 0 -1 4202560 1176 0 0 0 10 10 0 0 19 0 2 0 548539065 585089024 6465 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31935/statm: 142844 6465 407 364 0 78696 0
[pid=31937] ppid=31935 vsize=335996 CPUtime=98.73 cores=0-7
/proc/31937/stat : 31937 (iPAWS) T 31935 31937 31937 0 -1 4202496 1812 0 0 0 9873 0 0 0 25 0 1 0 548539065 344059904 1534 33554432000 134512640 135114423 4287849152 18446744073709551615 134517230 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/31937/statm: 83999 1534 59 147 0 83851 0
[pid=31935/tid=31940] ppid=31830 vsize=571376 CPUtime=0 cores=0-7
/proc/31935/task/31940/stat : 31940 (python) S 31830 31830 31414 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548548985 585089024 6465 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604451618056256 0 0 -1 0 0 0 0
[pid=31946] ppid=31830 vsize=581632 CPUtime=0.65 cores=0-7
/proc/31946/stat : 31946 (python) S 31830 31830 31414 0 -1 4202560 1208 0 0 0 33 32 0 0 18 0 2 0 548557059 595591168 6549 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/31946/statm: 145408 6549 406 364 0 81257 0
[pid=31948] ppid=31946 vsize=268424 CPUtime=291.64 cores=0-7
/proc/31948/stat : 31948 (hybridGM3) T 31946 31948 31948 0 -1 4202496 5409 0 0 0 29164 0 0 0 25 0 1 0 548557060 274866176 5127 33554432000 134512640 135204385 4293001696 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31948/statm: 67106 5127 63 169 0 66936 0
[pid=31946/tid=31960] ppid=31830 vsize=581632 CPUtime=0 cores=0-7
/proc/31946/task/31960/stat : 31960 (python) S 31830 31830 31414 0 -1 4202560 91 0 0 0 0 0 0 0 18 0 2 0 548579121 595591168 6549 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604440278878208 0 0 -1 6 0 0 0
[pid=31951] ppid=31830 vsize=591888 CPUtime=0.8 cores=0-7
/proc/31951/stat : 31951 (python) S 31830 31830 31414 0 -1 4202560 1181 0 0 0 42 38 0 0 18 0 2 0 548566236 606093312 6551 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31951/statm: 147972 6551 400 364 0 83818 0
[pid=31953] ppid=31951 vsize=268428 CPUtime=292.81 cores=0-7
/proc/31953/stat : 31953 (hybridGM3) T 31951 31953 31953 0 -1 4202496 5408 0 0 0 29280 1 0 0 25 0 1 0 548566236 274870272 5127 33554432000 134512640 135204385 4291942704 18446744073709551615 134538449 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/31953/statm: 67107 5127 63 169 0 66937 0
[pid=31951/tid=31964] ppid=31830 vsize=591888 CPUtime=0 cores=0-7
/proc/31951/task/31964/stat : 31964 (python) S 31830 31830 31414 0 -1 4202560 85 0 0 0 0 0 0 0 18 0 2 0 548587683 606093312 6551 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604453869691136 0 0 -1 6 0 0 0
[pid=31956] ppid=31830 vsize=602144 CPUtime=1.3 cores=0-7
/proc/31956/stat : 31956 (python) S 31830 31830 31414 0 -1 4202560 991 0 0 0 70 60 0 0 18 0 1 0 548572308 616595456 6499 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 6 0 0 0
/proc/31956/statm: 150536 6499 373 364 0 86379 0
[pid=31958] ppid=31956 vsize=458344 CPUtime=552.56 cores=0-7
/proc/31958/stat : 31958 (TNM) R 31956 31958 31958 0 -1 4202496 1523 0 0 0 55256 0 0 0 25 0 1 0 548572308 469344256 1239 33554432000 134512640 135008748 4293663952 18446744073709551615 134529367 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31958/statm: 114586 1239 46 122 0 113486 0
[pid=31965] ppid=31830 vsize=612400 CPUtime=0.2 cores=0-7
/proc/31965/stat : 31965 (python) S 31830 31830 31414 0 -1 4202560 1195 0 0 0 11 9 0 0 18 0 2 0 548587692 627097600 6535 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31965/statm: 153100 6535 401 364 0 88940 0
[pid=31967] ppid=31965 vsize=335996 CPUtime=97.36 cores=0-7
/proc/31967/stat : 31967 (iPAWS) T 31965 31967 31967 0 -1 4202496 1818 0 0 0 9736 0 0 0 25 0 1 0 548587693 344059904 1535 33554432000 134512640 135114423 4293766336 18446744073709551615 134517231 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31967/statm: 83999 1535 59 147 0 83851 0
[pid=31965/tid=31976] ppid=31830 vsize=612400 CPUtime=0 cores=0-7
/proc/31965/task/31976/stat : 31976 (python) S 31830 31830 31414 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 548597712 627097600 6535 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604453864233664 0 0 -1 4 0 0 0
[pid=31970] ppid=31830 vsize=622656 CPUtime=0.84 cores=0-7
/proc/31970/stat : 31970 (python) S 31830 31830 31414 0 -1 4202560 1000 0 0 0 47 37 0 0 18 0 1 0 548596105 637599744 6546 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 1 0 0 0
/proc/31970/statm: 155664 6546 373 364 0 91501 0
[pid=31972] ppid=31970 vsize=419776 CPUtime=331.01 cores=0-7
/proc/31972/stat : 31972 (NCVWr) R 31970 31972 31972 0 -1 4202496 1569 0 0 0 33099 2 0 0 25 0 1 0 548596105 429850624 1281 33554432000 134512640 135113558 4289345008 18446744073709551615 134533476 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31972/statm: 104944 1281 58 147 0 103819 0
[pid=31973] ppid=31830 vsize=632912 CPUtime=0.27 cores=0-7
/proc/31973/stat : 31973 (python) S 31830 31830 31414 0 -1 4202560 1227 0 0 0 15 12 0 0 19 0 2 0 548596972 648101888 6586 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31973/statm: 158228 6586 406 364 0 94062 0
[pid=31975] ppid=31973 vsize=1019708 CPUtime=102.99 cores=0-7
/proc/31975/stat : 31975 (gnovelty+2) T 31973 31975 31975 0 -1 4202496 978 0 0 0 10299 0 0 0 25 0 1 0 548596972 1044180992 690 33554432000 134512640 135663704 4287238080 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/31975/statm: 254927 690 113 282 0 254643 0
[pid=31973/tid=31990] ppid=31830 vsize=632912 CPUtime=0 cores=0-7
/proc/31973/task/31990/stat : 31990 (python) S 31830 31830 31414 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 548610509 648101888 6586 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604453867415360 0 0 -1 6 0 0 0
[pid=31991] ppid=31830 vsize=643168 CPUtime=0.2 cores=0-7
/proc/31991/stat : 31991 (python) S 31830 31830 31414 0 -1 4202560 1239 0 0 0 12 8 0 0 19 0 2 0 548610519 658604032 6662 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/31991/statm: 160792 6662 407 364 0 96623 0
[pid=31993] ppid=31991 vsize=335996 CPUtime=99.75 cores=0-7
/proc/31993/stat : 31993 (iPAWS) T 31991 31993 31993 0 -1 4202496 1820 0 0 0 9975 0 0 0 25 0 1 0 548610519 344059904 1536 33554432000 134512640 135114423 4292388400 18446744073709551615 134546153 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31993/statm: 83999 1536 59 147 0 83851 0
[pid=31991/tid=31996] ppid=31830 vsize=643168 CPUtime=0 cores=0-7
/proc/31991/task/31996/stat : 31996 (python) S 31830 31830 31414 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 548620538 658604032 6662 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604443288613120 0 0 -1 2 0 0 0
[pid=31997] ppid=31830 vsize=653424 CPUtime=0.34 cores=0-7
/proc/31997/stat : 31997 (python) S 31830 31830 31414 0 -1 4202560 1254 0 0 0 18 16 0 0 18 0 2 0 548620549 669106176 6625 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31997/statm: 163356 6625 407 364 0 99184 0
[pid=31999] ppid=31997 vsize=249872 CPUtime=153.02 cores=0-7
/proc/31999/stat : 31999 (FH) R 31997 31999 31999 0 -1 4202496 1555 0 0 0 15302 0 0 0 25 0 1 0 548620550 255868928 1264 33554432000 134512640 134936988 4290585104 18446744073709551615 134552066 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31999/statm: 62468 1264 41 104 0 61972 0
[pid=31997/tid=32009] ppid=31830 vsize=653424 CPUtime=0 cores=0-7
/proc/31997/task/32009/stat : 32009 (python) S 31830 31830 31414 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 548630570 669106176 6625 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 514 18446604443288614016 0 0 -1 1 0 0 0
[pid=32005] ppid=31830 vsize=663680 CPUtime=0.25 cores=0-7
/proc/32005/stat : 32005 (python) S 31830 31830 31414 0 -1 4202560 1058 0 0 0 13 12 0 0 18 0 1 0 548624438 679608320 6554 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 4811550844077965569 0 0 17 1 0 0 0
/proc/32005/statm: 165920 6554 378 364 0 101745 0
[pid=32007] ppid=32005 vsize=268420 CPUtime=74.6 cores=0-7
/proc/32007/stat : 32007 (hybridGM3) R 32005 32007 32007 0 -1 4202496 5415 0 0 0 7459 1 0 0 25 0 1 0 548624438 274862080 5125 33554432000 134512640 135204385 4287434864 18446744073709551615 134538386 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32007/statm: 67105 5125 63 169 0 66935 0
[pid=32012] ppid=31830 vsize=673936 CPUtime=0 cores=0-7
/proc/32012/stat : 32012 (python) S 31830 31830 31414 0 -1 4202560 915 0 0 0 0 0 0 0 19 0 1 0 548636533 690110464 6652 33554432000 4194304 5683644 140736996248048 18446744073709551615 274473987654 0 0 16781312 514 14791484191916687359 0 0 17 1 0 0 0
/proc/32012/statm: 168484 6652 346 364 0 104306 0
[pid=32014] ppid=32012 vsize=415124 CPUtime=0.14 cores=0-7
/proc/32014/stat : 32014 (NCVWr) R 32012 32014 32014 0 -1 4202496 1298 0 0 0 14 0 0 0 21 0 1 0 548636534 425086976 1007 33554432000 134512640 135113558 4290896080 18446744073709551615 134526466 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32014/statm: 103781 1007 55 147 0 102656 0
[pid=31830/tid=31837] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31837/stat : 31837 (python) S 31828 31830 31414 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 34 0 548483884 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 0 0 0 0
[pid=31830/tid=31840] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31840/stat : 31840 (python) S 31828 31830 31414 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 34 0 548483887 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 4 0 0 0
[pid=31830/tid=31843] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31843/stat : 31843 (python) S 31828 31830 31414 0 -1 4202560 26 933 0 0 0 0 0 0 15 0 34 0 548483891 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 3 0 0 0
[pid=31830/tid=31846] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31846/stat : 31846 (python) S 31828 31830 31414 0 -1 4202560 97 933 0 0 0 0 0 0 18 0 34 0 548483895 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 0 0 0 0
[pid=31830/tid=31849] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31849/stat : 31849 (python) S 31828 31830 31414 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 548483898 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 7 0 0 0
[pid=31830/tid=31852] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31852/stat : 31852 (python) S 31828 31830 31414 0 -1 4202560 30 933 0 0 0 0 0 0 19 0 34 0 548483902 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 1 0 0 0
[pid=31830/tid=31855] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31855/stat : 31855 (python) S 31828 31830 31414 0 -1 4202560 50 933 0 0 0 0 0 0 18 0 34 0 548483906 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31857] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31857/stat : 31857 (python) S 31828 31830 31414 0 -1 4202560 91 933 0 0 0 0 0 0 18 0 34 0 548483910 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31867] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31867/stat : 31867 (python) S 31828 31830 31414 0 -1 4202560 44 933 0 0 0 0 0 0 18 0 34 0 548493912 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31871] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31871/stat : 31871 (python) S 31828 31830 31414 0 -1 4202560 46 933 0 0 0 0 0 0 18 0 34 0 548493916 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 7 0 0 0
[pid=31830/tid=31874] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31874/stat : 31874 (python) S 31828 31830 31414 0 -1 4202560 53 933 0 0 0 0 0 0 18 0 34 0 548493921 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31879] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31879/stat : 31879 (python) S 31828 31830 31414 0 -1 4202560 32 933 0 0 0 0 0 0 23 0 34 0 548493928 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 3 0 0 0
[pid=31830/tid=31882] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31882/stat : 31882 (python) S 31828 31830 31414 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 548493933 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31885] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31885/stat : 31885 (python) S 31828 31830 31414 0 -1 4202560 56 933 0 0 0 0 0 0 18 0 34 0 548493939 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31890] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31890/stat : 31890 (python) S 31828 31830 31414 0 -1 4202560 50 933 0 0 0 0 0 0 18 0 34 0 548498717 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31894] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31894/stat : 31894 (python) S 31828 31830 31414 0 -1 4202560 39 933 0 0 0 0 0 0 18 0 34 0 548498756 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31899] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31899/stat : 31899 (python) S 31828 31830 31414 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 34 0 548503944 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31904] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31904/stat : 31904 (python) S 31828 31830 31414 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 34 0 548505162 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31917] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31917/stat : 31917 (python) S 31828 31830 31414 0 -1 4202560 56 933 0 0 0 0 0 0 18 0 34 0 548520596 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31921] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31921/stat : 31921 (python) S 31828 31830 31414 0 -1 4202560 37 933 0 0 0 0 0 0 20 0 34 0 548525418 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31926] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31926/stat : 31926 (python) S 31828 31830 31414 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 548529033 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31930] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31930/stat : 31930 (python) S 31828 31830 31414 0 -1 4202560 48 933 0 0 0 0 0 0 18 0 34 0 548531103 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31936] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31936/stat : 31936 (python) S 31828 31830 31414 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 34 0 548539065 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31947] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31947/stat : 31947 (python) S 31828 31830 31414 0 -1 4202560 45 933 0 0 0 0 0 0 18 0 34 0 548557059 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31952] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31952/stat : 31952 (python) S 31828 31830 31414 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 34 0 548566236 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31957] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31957/stat : 31957 (python) S 31828 31830 31414 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 34 0 548572308 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31966] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31966/stat : 31966 (python) S 31828 31830 31414 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 548587693 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31971] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31971/stat : 31971 (python) S 31828 31830 31414 0 -1 4202560 39 933 0 0 0 0 0 0 19 0 34 0 548596105 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31974] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31974/stat : 31974 (python) S 31828 31830 31414 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 548596972 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31992] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31992/stat : 31992 (python) S 31828 31830 31414 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 548610519 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=31998] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/31998/stat : 31998 (python) S 31828 31830 31414 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 548620549 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=32006] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/32006/stat : 32006 (python) S 31828 31830 31414 0 -1 4202560 36 933 0 0 0 0 0 0 19 0 34 0 548624438 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
[pid=31830/tid=32013] ppid=31828 vsize=684180 CPUtime=0 cores=0-7
/proc/31830/task/32013/stat : 32013 (python) S 31828 31830 31414 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 34 0 548636534 700600320 8252 33554432000 4194304 5683644 140736996248048 18446744073709551615 274485791153 0 0 16781312 2 18446604449906484480 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10720.9
Current children cumulated vsize (KiB) 32596856

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31830 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=399027
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=259960
# CPU time returned by wait4() is 6.65899
# while last known CPU time is 10720.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1529.1
CPU time (s): 10720.9
CPU user time (s): 10709
CPU system time (s): 11.89
CPU usage (%): 701.122
Max. virtual memory (cumulated for all children) (KiB): 32596856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.39903
system time used= 0.25996
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74205
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3162
involuntary context switches= 121

runsolver used 15.2107 second user time and 34.4378 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-02 22:40:40
IDJOB=3321871
IDBENCH=82649
IDSOLVER=1712
FILE ID=node125/3321871-1304368840
RUNJOBID= node125-1304366466-31428
PBS_JOBID= 13181746
Free space on /tmp= 73096 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S1158419275-045-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321871-1304368840/watcher-3321871-1304368840 -o /tmp/evaluation-result-3321871-1304368840/solver-3321871-1304368840 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321871-1304368840.cnf -seed 358744891 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ba96eb51c814e4238dd0a7b33e8bab2d
RANDOM SEED=358744891

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16379672 kB
Buffers:       2148496 kB
Cached:        7544320 kB
SwapCached:          4 kB
Active:       10094068 kB
Inactive:      5921828 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16379672 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           32284 kB
Writeback:           0 kB
AnonPages:     6323688 kB
Mapped:          23356 kB
Slab:           467048 kB
PageTables:      22848 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 18917772 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73064 MiB
End job on node125 at 2011-05-02 23:06:11