Trace number 3378099

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 4375.66 1105.05

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S883457431-033-UNKNOWN.cnf
MD5SUM0d0abbf84f73b4226aa3bedf08367d2e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark291.591
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.30/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.47	c INFO: solving HOME/instance-3378099-1305462645.cnf
0.30/0.48	c INFO: computing task features
0.79/0.99	c INFO: computed variable-clause graph statistics
0.90/1.01	c INFO: computed clause balance statistics
3.39/3.59	c INFO: computed variable balance statistics
5.59/5.70	c INFO: computed small-clause counts
5.59/5.72	c INFO: computed Horn-clause counts
7.09/7.28	c INFO: computed variable graph statistics
7.09/7.28	c INFO: collected features for HOME/instance-3378099-1305462645.cnf in 6.78 s
7.09/7.28	c INFO: running hybridGM3@0 for 97 with 1193 remaining (b = 0.36)
7.19/7.30	c INFO: running hybridGM3@0 for 97 with 1193 remaining (b = 0.21)
7.19/7.31	c INFO: running hybridGM3@0 for 97 with 1193 remaining (b = 0.14)
7.19/7.32	c INFO: running hybridGM3@0 for 194 with 1193 remaining (b = 0.18)
403.13/106.68	c INFO: running hybridGM3@0 for 97 with 1093 remaining (b = 0.08)
407.53/107.73	c INFO: running hybridGM3@0 for 97 with 1092 remaining (b = 0.08)
407.53/107.73	c INFO: running hybridGM3@0 for 97 with 1092 remaining (b = 0.08)
799.14/205.95	c INFO: running hybridGM3@99 for 97 with 994 remaining (b = 0.08)
803.53/207.01	c INFO: running hybridGM3@99 for 97 with 993 remaining (b = 0.08)
803.53/207.02	c INFO: running TNM@0 for 97 with 993 remaining (b = 0.10)
811.11/209.00	c INFO: running hybridGM3@99 for 97 with 991 remaining (b = 0.08)
1170.82/299.21	c INFO: running hybridGM3@100 for 97 with 901 remaining (b = 0.08)
1175.19/300.28	c INFO: running hybridGM3@0 for 97 with 900 remaining (b = 0.07)
1187.11/303.25	c INFO: running hybridGM3@192 for 97 with 897 remaining (b = 0.06)
1203.04/307.30	c INFO: running hybridGM3@0 for 194 with 893 remaining (b = 0.10)
1557.95/396.47	c INFO: running hybridGM3@193 for 97 with 804 remaining (b = 0.04)
1575.08/400.72	c INFO: running hybridGM3@94 for 97 with 799 remaining (b = 0.04)
1590.20/404.51	c INFO: running hybridGM3@0 for 194 with 795 remaining (b = 0.07)
1937.14/491.74	c INFO: running hybridGM3@0 for 194 with 708 remaining (b = 0.06)
1953.78/495.98	c INFO: running hybridGM3@297 for 97 with 704 remaining (b = 0.02)
2009.89/510.03	c INFO: running hybridGM3@96 for 97 with 690 remaining (b = 0.03)
2340.85/593.26	c INFO: running hybridGM3@293 for 97 with 607 remaining (b = 0.02)
2372.68/601.20	c INFO: running hybridGM3@95 for 97 with 599 remaining (b = 0.03)
2388.98/605.30	c INFO: running hybridGM3@193 for 97 with 595 remaining (b = 0.03)
2727.93/690.55	c INFO: running TNM@0 for 97 with 509 remaining (b = 0.02)
2743.41/694.48	c INFO: running hybridGM3@95 for 97 with 505 remaining (b = 0.02)
2775.22/702.48	c INFO: running hybridGM3@189 for 97 with 497 remaining (b = 0.02)
2791.52/706.59	c INFO: running hybridGM3@0 for 194 with 493 remaining (b = 0.04)
3122.43/789.75	c INFO: running TNM@0 for 97 with 410 remaining (b = 0.02)
3126.80/790.84	c INFO: running TNM@198 for 409 with 409 remaining (b = 0.06)
3154.19/797.75	c INFO: running hybridGM3@0 for 194 with 402 remaining (b = 0.03)
3521.28/890.06	c INFO: running hybridGM3@0 for 194 with 310 remaining (b = 0.03)
3574.14/903.34	c INFO: running hybridGM3@93 for 97 with 297 remaining (b = 0.01)
3936.46/994.48	c INFO: running hybridGM3@97 for 97 with 206 remaining (b = 0.01)
3976.95/1004.64	c INFO: running TNM@0 for 97 with 195 remaining (b = 0.01)
4314.58/1089.76	c INFO: running TNM@0 for 110 with 110 remaining (b = 0.01)
4326.84/1092.81	c INFO: running TNM@0 for 107 with 107 remaining (b = 0.01)
4375.45/1105.02	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378099-1305462645/watcher-3378099-1305462645 -o /tmp/evaluation-result-3378099-1305462645/solver-3378099-1305462645 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378099-1305462645.cnf -seed 1140004173 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.55 2.10 2.63 6/352 7390
/proc/meminfo: memFree=17111852/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 871 0 0 0 0 0 0 0 25 0 1 0 657864239 16154624 753 33554432000 4194304 5683644 140735818228096 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7390/statm: 3944 753 343 364 0 431 0

[startup+0.014661 s]
/proc/loadavg: 3.55 2.10 2.63 6/352 7390
/proc/meminfo: memFree=17111852/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=16240 CPUtime=0 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 1041 0 0 0 0 0 0 0 25 0 1 0 657864239 16629760 913 33554432000 4194304 5683644 140735818228096 18446744073709551615 4887611 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7390/statm: 4060 913 380 364 0 547 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16240

[startup+0.100649 s]
/proc/loadavg: 3.55 2.10 2.63 6/352 7390
/proc/meminfo: memFree=17111852/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=96952 CPUtime=0.06 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 2779 0 0 0 5 1 0 0 25 0 1 0 657864239 99278848 2484 33554432000 4194304 5683644 140735818228096 18446744073709551615 274469044327 0 0 16781312 2 0 0 0 17 5 0 0 1
/proc/7390/statm: 24238 2493 769 364 0 1686 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96952

[startup+0.300612 s]
/proc/loadavg: 3.55 2.10 2.63 6/352 7390
/proc/meminfo: memFree=17111852/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=156836 CPUtime=0.22 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 6452 938 1 0 16 6 0 0 25 0 1 0 657864239 160600064 4565 33554432000 4194304 5683644 140735818228096 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 3 0 0 1
/proc/7390/statm: 39209 4567 1257 364 0 3317 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 156836

[startup+0.700541 s]
/proc/loadavg: 3.55 2.10 2.63 6/352 7390
/proc/meminfo: memFree=17111852/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=294836 CPUtime=0.6 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 13267 938 1 0 49 11 0 0 25 0 1 0 657864239 301912064 10949 33554432000 4194304 5683644 140735818228096 18446744073709551615 4272792 0 0 16781312 2 0 0 0 17 3 0 0 1
/proc/7390/statm: 73709 10950 1761 364 0 9633 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 294836

[startup+1.5004 s]
/proc/loadavg: 3.55 2.10 2.63 6/353 7395
/proc/meminfo: memFree=17054928/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=312976 CPUtime=1.39 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 21968 938 1 0 128 11 0 0 25 0 1 0 657864239 320487424 15629 33554432000 4194304 5683644 140735818228096 18446744073709551615 47443913045938 0 0 16781312 2 0 0 0 17 3 0 0 1
/proc/7390/statm: 78244 15629 1826 364 0 14168 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 312976

[startup+3.10012 s]
/proc/loadavg: 3.55 2.10 2.63 6/353 7395
/proc/meminfo: memFree=17054408/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=312976 CPUtime=2.99 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 21968 938 1 0 288 11 0 0 25 0 1 0 657864239 320487424 15629 33554432000 4194304 5683644 140735818228096 18446744073709551615 4602441 0 0 16781312 2 0 0 0 17 3 0 0 1
/proc/7390/statm: 78244 15629 1826 364 0 14168 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 312976

[startup+6.30055 s]
/proc/loadavg: 3.83 2.18 2.65 6/353 7395
/proc/meminfo: memFree=17054724/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=312976 CPUtime=6.19 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 21975 938 1 0 608 11 0 0 25 0 1 0 657864239 320487424 15636 33554432000 4194304 5683644 140735818228096 18446744073709551615 47443912976524 0 0 16781312 2 0 0 0 17 3 0 0 1
/proc/7390/statm: 78244 15636 1833 364 0 14168 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 312976

[startup+12.7014 s]
/proc/loadavg: 4.16 2.28 2.68 9/365 7407
/proc/meminfo: memFree=16915928/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=351280 CPUtime=7.21 cores=1,3,5,7
/proc/7390/stat : 7390 (python) S 7388 7390 7291 0 -1 4202496 24771 938 1 0 709 12 0 0 25 0 5 0 657864239 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/7390/statm: 87820 15009 1873 364 0 23729 0
[pid=7396] ppid=7390 vsize=310268 CPUtime=0.01 cores=1,3,5,7
/proc/7396/stat : 7396 (python) S 7390 7390 7291 0 -1 4202560 888 0 0 0 0 1 0 0 15 0 1 0 657864968 317714432 13496 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987599 0 0 16781312 514 12510455235996516616 0 0 17 7 0 0 0
/proc/7396/statm: 77567 13496 376 364 0 13485 0
[pid=7399] ppid=7396 vsize=268420 CPUtime=5.39 cores=1,3,5,7
/proc/7399/stat : 7399 (hybridGM3) R 7396 7399 7399 0 -1 4202496 8081 0 0 0 538 1 0 0 25 0 1 0 657864969 274862080 7818 33554432000 134512640 135204385 4287527872 18446744073709551615 134537272 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7399/statm: 67105 7818 64 169 0 66935 0
[pid=7398] ppid=7390 vsize=320524 CPUtime=0.01 cores=1,3,5,7
/proc/7398/stat : 7398 (python) S 7390 7390 7291 0 -1 4202560 914 0 0 0 1 0 0 0 15 0 1 0 657864969 328216576 13494 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 4261699102095409416 0 0 17 3 0 0 0
/proc/7398/statm: 80131 13494 370 364 0 16046 0
[pid=7401] ppid=7398 vsize=268424 CPUtime=5.39 cores=1,3,5,7
/proc/7401/stat : 7401 (hybridGM3) R 7398 7401 7401 0 -1 4202496 8084 0 0 0 538 1 0 0 25 0 1 0 657864969 274866176 7822 33554432000 134512640 135204385 4287584416 18446744073709551615 134536922 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7401/statm: 67106 7822 64 169 0 66936 0
[pid=7402] ppid=7390 vsize=330780 CPUtime=0.01 cores=1,3,5,7
/proc/7402/stat : 7402 (python) S 7390 7390 7291 0 -1 4202560 900 0 0 0 0 1 0 0 15 0 1 0 657864970 338718720 13498 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 4261695253804712200 0 0 17 3 0 0 0
/proc/7402/statm: 82695 13498 370 364 0 18607 0
[pid=7404] ppid=7402 vsize=268428 CPUtime=5.34 cores=1,3,5,7
/proc/7404/stat : 7404 (hybridGM3) R 7402 7404 7404 0 -1 4202496 8082 0 0 0 534 0 0 0 25 0 1 0 657864971 274870272 7824 33554432000 134512640 135204385 4293433392 18446744073709551615 134537027 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7404/statm: 67107 7824 64 169 0 66937 0
[pid=7405] ppid=7390 vsize=341036 CPUtime=0 cores=1,3,5,7
/proc/7405/stat : 7405 (python) S 7390 7390 7291 0 -1 4202560 920 0 0 0 0 0 0 0 15 0 1 0 657864971 349220864 13502 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 650145352967487750 0 0 17 7 0 0 0
/proc/7405/statm: 85259 13502 370 364 0 21168 0
[pid=7407] ppid=7405 vsize=268428 CPUtime=5.26 cores=1,3,5,7
/proc/7407/stat : 7407 (hybridGM3) R 7405 7407 7407 0 -1 4202496 8078 0 0 0 525 1 0 0 25 0 1 0 657864971 274870272 7818 33554432000 134512640 135204385 4289365632 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7407/statm: 67107 7818 64 169 0 66937 0
[pid=7390/tid=7397] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7397/stat : 7397 (python) S 7388 7390 7291 0 -1 4202560 62 938 0 0 0 0 0 0 25 0 5 0 657864968 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7400] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7400/stat : 7400 (python) S 7388 7390 7291 0 -1 4202560 24 938 0 0 0 0 0 0 25 0 5 0 657864969 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7403] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7403/stat : 7403 (python) S 7388 7390 7291 0 -1 4202560 25 938 0 0 0 0 0 0 25 0 5 0 657864970 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7406] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7406/stat : 7406 (python) S 7388 7390 7291 0 -1 4202560 31 938 0 0 0 0 0 0 25 0 5 0 657864971 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 28.62
Current children cumulated vsize (KiB) 2727588

[startup+25.5012 s]
/proc/loadavg: 5.01 2.56 2.76 9/365 7408
/proc/meminfo: memFree=16916432/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=351280 CPUtime=7.21 cores=1,3,5,7
/proc/7390/stat : 7390 (python) S 7388 7390 7291 0 -1 4202496 24771 938 1 0 709 12 0 0 25 0 5 0 657864239 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/7390/statm: 87820 15009 1873 364 0 23729 0
[pid=7396] ppid=7390 vsize=310268 CPUtime=0.04 cores=1,3,5,7
/proc/7396/stat : 7396 (python) S 7390 7390 7291 0 -1 4202560 895 0 0 0 2 2 0 0 15 0 1 0 657864968 317714432 13496 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987599 0 0 16781312 514 7100751645293641992 0 0 17 7 0 0 0
/proc/7396/statm: 77567 13496 376 364 0 13485 0
[pid=7399] ppid=7396 vsize=268420 CPUtime=18.19 cores=1,3,5,7
/proc/7399/stat : 7399 (hybridGM3) R 7396 7399 7399 0 -1 4202496 8083 0 0 0 1818 1 0 0 25 0 1 0 657864969 274862080 7820 33554432000 134512640 135204385 4287527872 18446744073709551615 134537401 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7399/statm: 67105 7820 64 169 0 66935 0
[pid=7398] ppid=7390 vsize=320524 CPUtime=0.04 cores=1,3,5,7
/proc/7398/stat : 7398 (python) S 7390 7390 7291 0 -1 4202560 919 0 0 0 2 2 0 0 15 0 1 0 657864969 328216576 13494 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641992 0 0 17 3 0 0 0
/proc/7398/statm: 80131 13494 370 364 0 16046 0
[pid=7401] ppid=7398 vsize=268424 CPUtime=18.19 cores=1,3,5,7
/proc/7401/stat : 7401 (hybridGM3) R 7398 7401 7401 0 -1 4202496 8084 0 0 0 1818 1 0 0 25 0 1 0 657864969 274866176 7822 33554432000 134512640 135204385 4287584416 18446744073709551615 134536676 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7401/statm: 67106 7822 64 169 0 66936 0
[pid=7402] ppid=7390 vsize=330780 CPUtime=0.04 cores=1,3,5,7
/proc/7402/stat : 7402 (python) S 7390 7390 7291 0 -1 4202560 906 0 0 0 2 2 0 0 15 0 1 0 657864970 338718720 13498 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641992 0 0 17 3 0 0 0
/proc/7402/statm: 82695 13498 370 364 0 18607 0
[pid=7404] ppid=7402 vsize=268428 CPUtime=18.08 cores=1,3,5,7
/proc/7404/stat : 7404 (hybridGM3) R 7402 7404 7404 0 -1 4202496 8082 0 0 0 1808 0 0 0 25 0 1 0 657864971 274870272 7824 33554432000 134512640 135204385 4293433392 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7404/statm: 67107 7824 64 169 0 66937 0
[pid=7405] ppid=7390 vsize=341036 CPUtime=0.04 cores=1,3,5,7
/proc/7405/stat : 7405 (python) S 7390 7390 7291 0 -1 4202560 925 0 0 0 2 2 0 0 15 0 1 0 657864971 349220864 13502 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641990 0 0 17 7 0 0 0
/proc/7405/statm: 85259 13502 370 364 0 21168 0
[pid=7407] ppid=7405 vsize=268428 CPUtime=17.84 cores=1,3,5,7
/proc/7407/stat : 7407 (hybridGM3) R 7405 7407 7407 0 -1 4202496 8085 0 0 0 1783 1 0 0 25 0 1 0 657864971 274870272 7825 33554432000 134512640 135204385 4289365632 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7407/statm: 67107 7825 64 169 0 66937 0
[pid=7390/tid=7397] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7397/stat : 7397 (python) S 7388 7390 7291 0 -1 4202560 62 938 0 0 0 0 0 0 25 0 5 0 657864968 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7400] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7400/stat : 7400 (python) S 7388 7390 7291 0 -1 4202560 24 938 0 0 0 0 0 0 25 0 5 0 657864969 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7403] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7403/stat : 7403 (python) S 7388 7390 7291 0 -1 4202560 25 938 0 0 0 0 0 0 25 0 5 0 657864970 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7406] ppid=7388 vsize=351280 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7406/stat : 7406 (python) S 7388 7390 7291 0 -1 4202560 31 938 0 0 0 0 0 0 25 0 5 0 657864971 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 79.67
Current children cumulated vsize (KiB) 2727588

[startup+51.1007 s]
/proc/loadavg: 6.09 3.01 2.90 9/365 7408
/proc/meminfo: memFree=16915356/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=351280 CPUtime=7.21 cores=1,3,5,7
/proc/7390/stat : 7390 (python) S 7388 7390 7291 0 -1 4202496 24771 938 1 0 709 12 0 0 25 0 5 0 657864239 359710720 15009 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 1
/proc/7390/statm: 87820 15009 1873 364 0 23729 0
[pid=7396] ppid=7390 vsize=310268 CPUtime=0.11 cores=1,3,5,7
/proc/7396/stat : 7396 (python) S 7390 7390 7291 0 -1 4202560 904 0 0 0 6 5 0 0 15 0 1 0 657864968 317714432 13496 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987599 0 0 16781312 514 7100751645293641992 0 0 17 7 0 0 0
/proc/7396/statm: 77567 13496 376 364 0 13485 0
[pid=7399] ppid=7396 vsize=268420 CPUtime=43.79 cores=1,3,5,7
/proc/7399/stat : 7399 (hybridGM3) R 7396 7399 7399 0 -1 4202496 8085 0 0 0 4378 1 0 0 25 0 1 0 657864969 274862080 7822 33554432000 134512640 135204385 4287527872 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7399/statm: 67105 7822 64 169 0 66935 0
[pid=7398] ppid=7390 vsize=320524 CPUtime=0.11 cores=1,3,5,7
/proc/7398/stat : 7398 (python) S 7390 7390 7291 0 -1 4202560 929 0 0 0 6 5 0 0 15 0 1 0 657864969 328216576 13494 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641992 0 0 17 3 0 0 0
/proc/7398/statm: 80131 13494 370 364 0 16046 0
[pid=7401] ppid=7398 vsize=268424 CPUtime=43.78 cores=1,3,5,7
/proc/7401/stat : 7401 (hybridGM3) R 7398 7401 7401 0 -1 4202496 8084 0 0 0 4377 1 0 0 25 0 1 0 657864969 274866176 7822 33554432000 134512640 135204385 4287584416 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7401/statm: 67106 7822 64 169 0 66936 0
[pid=7402] ppid=7390 vsize=330780 CPUtime=0.1 cores=1,3,5,7
/proc/7402/stat : 7402 (python) S 7390 7390 7291 0 -1 4202560 916 0 0 0 6 4 0 0 15 0 1 0 657864970 338718720 13498 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641992 0 0 17 3 0 0 0
/proc/7402/statm: 82695 13498 370 364 0 18607 0
[pid=7404] ppid=7402 vsize=268428 CPUtime=43.56 cores=1,3,5,7
/proc/7404/stat : 7404 (hybridGM3) R 7402 7404 7404 0 -1 4202496 8082 0 0 0 4355 1 0 0 25 0 1 0 657864971 274870272 7824 33554432000 134512640 135204385 4293433392 18446744073709551615 134537383 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7404/statm: 67107 7824 64 169 0 66937 0
[pid=7405] ppid=7390 vsize=341036 CPUtime=0.11 cores=1,3,5,7
/proc/7405/stat : 7405 (python) S 7390 7390 7291 0 -1 4202560 931 0 0 0 5 6 0 0 15 0 1 0 657864971 349220864 13502 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641990 0 0 17 7 0 0 0
/proc/7405/statm: 85259 13502 370 364 0 21168 0

################
# More data... #
################

/proc/7559/stat : 7559 (python) S 7390 7390 7291 0 -1 4202560 1173 0 0 0 58 63 0 0 18 0 2 0 657933294 412233728 13556 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7559/statm: 100643 13556 399 364 0 36534 0
[pid=7561] ppid=7559 vsize=465044 CPUtime=413.66 cores=1,3,5,7
/proc/7561/stat : 7561 (TNM) R 7559 7561 7561 0 -1 4202496 6016 0 0 0 41366 0 0 0 25 0 1 0 657933294 476205056 5750 33554432000 134512640 135008748 4287176736 18446744073709551615 134524720 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7561/statm: 116261 5750 46 122 0 115161 0
[pid=7559/tid=7583] ppid=7390 vsize=402572 CPUtime=0 cores=1,3,5,7
/proc/7559/task/7583/stat : 7583 (python) S 7390 7390 7291 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657943322 412233728 13556 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 514 18446604457753393152 0 0 -1 7 0 0 0
[pid=7564] ppid=7390 vsize=412828 CPUtime=0.88 cores=1,3,5,7
/proc/7564/stat : 7564 (python) S 7390 7390 7291 0 -1 4202560 1172 0 0 0 43 45 0 0 15 0 2 0 657934898 422735872 13560 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7564/statm: 103207 13560 399 364 0 39095 0
[pid=7566] ppid=7564 vsize=268420 CPUtime=294.96 cores=1,3,5,7
/proc/7566/stat : 7566 (hybridGM3) T 7564 7566 7566 0 -1 4202496 8096 0 0 0 29495 1 0 0 25 0 1 0 657934900 274862080 7831 33554432000 134512640 135204385 4293614400 18446744073709551615 134547490 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/7566/statm: 67105 7831 64 169 0 66935 0
[pid=7564/tid=7594] ppid=7390 vsize=412828 CPUtime=0 cores=1,3,5,7
/proc/7564/task/7594/stat : 7594 (python) S 7390 7390 7291 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 657954572 422735872 13560 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 514 18446604458174697664 0 0 -1 3 0 0 0
[pid=7580] ppid=7390 vsize=423084 CPUtime=0.3 cores=1,3,5,7
/proc/7580/stat : 7580 (python) S 7390 7390 7291 0 -1 4202560 1133 0 0 0 13 17 0 0 19 0 2 0 657943214 433238016 13564 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7580/statm: 105771 13564 399 364 0 41656 0
[pid=7582] ppid=7580 vsize=465044 CPUtime=98.01 cores=1,3,5,7
/proc/7582/stat : 7582 (TNM) T 7580 7582 7582 0 -1 4202496 6014 0 0 0 9800 1 0 0 25 0 1 0 657943215 476205056 5749 33554432000 134512640 135008748 4293126352 18446744073709551615 134527553 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/7582/statm: 116261 5749 46 122 0 115161 0
[pid=7580/tid=7590] ppid=7390 vsize=423084 CPUtime=0 cores=1,3,5,7
/proc/7580/task/7590/stat : 7590 (python) S 7390 7390 7291 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657953244 433238016 13564 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 514 18446604454223472448 0 0 -1 7 0 0 0
[pid=7584] ppid=7390 vsize=433340 CPUtime=0.88 cores=1,3,5,7
/proc/7584/stat : 7584 (python) S 7390 7390 7291 0 -1 4202560 1176 0 0 0 39 49 0 0 15 0 2 0 657944014 443740160 13568 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7584/statm: 108335 13568 399 364 0 44217 0
[pid=7586] ppid=7584 vsize=268424 CPUtime=291.87 cores=1,3,5,7
/proc/7586/stat : 7586 (hybridGM3) T 7584 7586 7586 0 -1 4202496 8095 0 0 0 29184 3 0 0 25 0 1 0 657944014 274866176 7827 33554432000 134512640 135204385 4289973248 18446744073709551615 134536843 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/7586/statm: 67106 7827 64 169 0 66936 0
[pid=7584/tid=7603] ppid=7390 vsize=433340 CPUtime=0 cores=1,3,5,7
/proc/7584/task/7603/stat : 7603 (python) S 7390 7390 7291 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 657963686 443740160 13568 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 514 18446604459768299584 0 0 -1 3 0 0 0
[pid=7591] ppid=7390 vsize=443596 CPUtime=0.61 cores=1,3,5,7
/proc/7591/stat : 7591 (python) S 7390 7390 7291 0 -1 4202560 1184 0 0 0 26 35 0 0 16 0 2 0 657953245 454242304 13572 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7591/statm: 110899 13572 399 364 0 46778 0
[pid=7593] ppid=7591 vsize=268424 CPUtime=197.27 cores=1,3,5,7
/proc/7593/stat : 7593 (hybridGM3) T 7591 7593 7593 0 -1 4202496 8097 0 0 0 19725 2 0 0 25 0 1 0 657953246 274866176 7827 33554432000 134512640 135204385 4290709040 18446744073709551615 134546102 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/7593/statm: 67106 7827 64 169 0 66936 0
[pid=7591/tid=7620] ppid=7390 vsize=443596 CPUtime=0 cores=1,3,5,7
/proc/7591/task/7620/stat : 7620 (python) S 7390 7390 7291 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 657973519 454242304 13572 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 514 18446604470904381760 0 0 -1 3 0 0 0
[pid=7605] ppid=7390 vsize=453852 CPUtime=0.28 cores=1,3,5,7
/proc/7605/stat : 7605 (python) S 7390 7390 7291 0 -1 4202560 1049 0 0 0 12 16 0 0 18 0 1 0 657964703 464744448 13553 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641988 0 0 17 3 0 0 0
/proc/7605/statm: 113463 13553 377 364 0 49339 0
[pid=7607] ppid=7605 vsize=465044 CPUtime=99.07 cores=1,3,5,7
/proc/7607/stat : 7607 (TNM) R 7605 7607 7607 0 -1 4202496 6024 0 0 0 9906 1 0 0 25 0 1 0 657964704 476205056 5749 33554432000 134512640 135008748 4290644048 18446744073709551615 134529292 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/7607/statm: 116261 5749 46 122 0 115161 0
[pid=7617] ppid=7390 vsize=464108 CPUtime=0.03 cores=1,3,5,7
/proc/7617/stat : 7617 (python) S 7390 7390 7291 0 -1 4202560 1005 0 0 0 1 2 0 0 18 0 1 0 657973215 475246592 13557 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641990 0 0 17 3 0 0 0
/proc/7617/statm: 116027 13557 377 364 0 51900 0
[pid=7619] ppid=7617 vsize=465044 CPUtime=14.69 cores=1,3,5,7
/proc/7619/stat : 7619 (TNM) R 7617 7619 7619 0 -1 4202496 6023 0 0 0 1468 1 0 0 25 0 1 0 657973216 476205056 5749 33554432000 134512640 135008748 4293155456 18446744073709551615 134524754 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7619/statm: 116261 5749 46 122 0 115161 0
[pid=7621] ppid=7390 vsize=474364 CPUtime=0.03 cores=1,3,5,7
/proc/7621/stat : 7621 (python) S 7390 7390 7291 0 -1 4202560 1009 0 0 0 1 2 0 0 18 0 1 0 657973520 485748736 13562 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641990 0 0 17 3 0 0 0
/proc/7621/statm: 118591 13562 378 364 0 54461 0
[pid=7623] ppid=7621 vsize=465044 CPUtime=12.07 cores=1,3,5,7
/proc/7623/stat : 7623 (TNM) R 7621 7623 7623 0 -1 4202496 6023 0 0 0 1206 1 0 0 25 0 1 0 657973520 476205056 5749 33554432000 134512640 135008748 4290985504 18446744073709551615 134527091 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7623/statm: 116261 5749 46 122 0 115161 0
[pid=7390/tid=7397] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7397/stat : 7397 (python) S 7388 7390 7291 0 -1 4202560 68 938 0 0 0 0 0 0 18 0 18 0 657864968 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7400] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7400/stat : 7400 (python) S 7388 7390 7291 0 -1 4202560 31 938 0 0 0 0 0 0 18 0 18 0 657864969 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7403] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7403/stat : 7403 (python) S 7388 7390 7291 0 -1 4202560 45 938 0 0 0 0 0 0 15 0 18 0 657864970 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7406] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7406/stat : 7406 (python) S 7388 7390 7291 0 -1 4202560 40 938 0 0 0 0 0 0 18 0 18 0 657864971 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7506] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7506/stat : 7506 (python) S 7388 7390 7291 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 18 0 657884941 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7515] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7515/stat : 7515 (python) S 7388 7390 7291 0 -1 4202560 33 938 0 0 0 0 0 0 18 0 18 0 657894267 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7519] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7519/stat : 7519 (python) S 7388 7390 7291 0 -1 4202560 32 938 0 0 0 0 0 0 18 0 18 0 657894969 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7530] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7530/stat : 7530 (python) S 7388 7390 7291 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 18 0 657904690 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7542] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7542/stat : 7542 (python) S 7388 7390 7291 0 -1 4202560 25 938 0 0 0 0 0 0 18 0 18 0 657913413 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7560] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7560/stat : 7560 (python) S 7388 7390 7291 0 -1 4202560 29 938 0 0 0 0 0 0 18 0 18 0 657933294 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7565] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7565/stat : 7565 (python) S 7388 7390 7291 0 -1 4202560 28 938 0 0 0 0 0 0 18 0 18 0 657934898 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7581] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7581/stat : 7581 (python) S 7388 7390 7291 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 18 0 657943214 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7585] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7585/stat : 7585 (python) S 7388 7390 7291 0 -1 4202560 30 938 0 0 0 0 0 0 18 0 18 0 657944014 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7592] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7592/stat : 7592 (python) S 7388 7390 7291 0 -1 4202560 31 938 0 0 0 0 0 0 20 0 18 0 657953245 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7606] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7606/stat : 7606 (python) S 7388 7390 7291 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 18 0 657964703 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7618] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7618/stat : 7618 (python) S 7388 7390 7291 0 -1 4202560 27 938 0 0 0 0 0 0 20 0 18 0 657973215 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7622] ppid=7388 vsize=484608 CPUtime=0 cores=1,3,5,7
/proc/7390/task/7622/stat : 7622 (python) S 7388 7390 7291 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 18 0 657973520 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4374.81
Current children cumulated vsize (KiB) 12907148

[startup+1105 s]
/proc/loadavg: 8.23 8.05 6.47 9/464 7623
/proc/meminfo: memFree=15837260/32950928 swapFree=67111348/67111528
[pid=7390] ppid=7388 vsize=484608 CPUtime=3636.21 cores=1,3,5,7
/proc/7390/stat : 7390 (python) R 7388 7390 7291 0 -1 4202496 38100 108226 1 0 739 18 362313 551 17 0 18 0 657864239 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 4532142 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 1
/proc/7390/statm: 121152 15096 1908 364 0 57022 0
[pid=7559] ppid=7390 vsize=402572 CPUtime=1.21 cores=1,3,5,7
/proc/7559/stat : 7559 (python) S 7390 7390 7291 0 -1 4202560 1173 0 0 0 58 63 0 0 18 0 2 0 657933294 412233728 13556 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7559/statm: 100643 13556 399 364 0 36534 0
[pid=7561] ppid=7559 vsize=465044 CPUtime=413.76 cores=1,3,5,7
/proc/7561/stat : 7561 (TNM) R 7559 7561 7561 0 -1 4202496 6016 0 0 0 41376 0 0 0 25 0 1 0 657933294 476205056 5750 33554432000 134512640 135008748 4287176736 18446744073709551615 134527693 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7561/statm: 116261 5750 46 122 0 115161 0
[pid=7559/tid=7583] ppid=7390 vsize=402572 CPUtime=0 cores=1,3,5,7
/proc/7559/task/7583/stat : 7583 (python) S 7390 7390 7291 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657943322 412233728 13556 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 514 18446604457753393152 0 0 -1 7 0 0 0
[pid=7591] ppid=7390 vsize=443596 CPUtime=0.61 cores=1,3,5,7
/proc/7591/stat : 7591 (python) S 7390 7390 7291 0 -1 4202560 1187 0 0 0 26 35 0 0 16 0 2 0 657953245 454242304 13572 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485797695 0 0 16781824 2 18446744073709551615 0 0 17 3 0 0 0
/proc/7591/statm: 110899 13572 399 364 0 46778 0
[pid=7593] ppid=7591 vsize=268424 CPUtime=197.27 cores=1,3,5,7
/proc/7593/stat : 7593 (hybridGM3) R 7591 7593 7593 0 -1 4202496 8097 0 0 0 19725 2 0 0 18 0 1 0 657953246 274866176 7827 33554432000 134512640 135204385 4290709040 18446744073709551615 134546102 256 0 16781312 0 0 0 0 17 7 0 0 0
/proc/7593/statm: 67106 7827 64 169 0 66936 0
[pid=7591/tid=7620] ppid=7390 vsize=443596 CPUtime=0 cores=1,3,5,7
/proc/7591/task/7620/stat : 7620 (python) S 7390 7390 7291 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 657973519 454242304 13572 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781824 2 18446604470904381760 0 0 -1 3 0 0 0
[pid=7605] ppid=7390 vsize=453852 CPUtime=0.3 cores=1,3,5,7
/proc/7605/stat : 7605 (python) S 7390 7390 7291 0 -1 4202560 1213 0 0 0 13 17 0 0 19 0 2 0 657964703 464744448 13583 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/7605/statm: 113463 13583 406 364 0 49339 0
[pid=7607] ppid=7605 vsize=465044 CPUtime=99.09 cores=1,3,5,7
/proc/7607/stat : 7607 (TNM) T 7605 7607 7607 0 -1 4202496 6024 0 0 0 9908 1 0 0 25 0 1 0 657964704 476205056 5749 33554432000 134512640 135008748 4290644048 18446744073709551615 134528967 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/7607/statm: 116261 5749 46 122 0 115161 0
[pid=7617] ppid=7390 vsize=464108 CPUtime=0.03 cores=1,3,5,7
/proc/7617/stat : 7617 (python) S 7390 7390 7291 0 -1 4202560 1005 0 0 0 1 2 0 0 18 0 1 0 657973215 475246592 13557 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641990 0 0 17 3 0 0 0
/proc/7617/statm: 116027 13557 377 364 0 51900 0
[pid=7619] ppid=7617 vsize=465044 CPUtime=14.78 cores=1,3,5,7
/proc/7619/stat : 7619 (TNM) R 7617 7619 7619 0 -1 4202496 6023 0 0 0 1477 1 0 0 25 0 1 0 657973216 476205056 5749 33554432000 134512640 135008748 4293155456 18446744073709551615 134527091 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/7619/statm: 116261 5749 46 122 0 115161 0
[pid=7621] ppid=7390 vsize=474364 CPUtime=0.03 cores=1,3,5,7
/proc/7621/stat : 7621 (python) S 7390 7390 7291 0 -1 4202560 1009 0 0 0 1 2 0 0 18 0 1 0 657973520 485748736 13562 33554432000 4194304 5683644 140735818228096 18446744073709551615 274473987654 0 0 16781312 514 7100751645293641990 0 0 17 3 0 0 0
/proc/7621/statm: 118591 13562 378 364 0 54461 0
[pid=7623] ppid=7621 vsize=465044 CPUtime=12.16 cores=1,3,5,7
/proc/7623/stat : 7623 (TNM) R 7621 7623 7623 0 -1 4202496 6023 0 0 0 1215 1 0 0 25 0 1 0 657973520 476205056 5749 33554432000 134512640 135008748 4290985504 18446744073709551615 134529448 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/7623/statm: 116261 5749 46 122 0 115161 0
[pid=7390/tid=7397] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7397/stat : 7397 (python) S 7388 7390 7291 0 -1 4202560 68 108226 0 0 0 0 362313 551 18 0 18 0 657864968 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7400] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7400/stat : 7400 (python) S 7388 7390 7291 0 -1 4202560 31 108226 0 0 0 0 362313 551 18 0 18 0 657864969 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7403] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7403/stat : 7403 (python) S 7388 7390 7291 0 -1 4202560 45 108226 0 0 0 0 362313 551 15 0 18 0 657864970 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7406] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7406/stat : 7406 (python) S 7388 7390 7291 0 -1 4202560 40 108226 0 0 0 0 362313 551 18 0 18 0 657864971 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 7 0 0 0
[pid=7390/tid=7506] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7506/stat : 7506 (python) S 7388 7390 7291 0 -1 4202560 28 108226 0 0 0 0 362313 551 20 0 18 0 657884941 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7515] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7515/stat : 7515 (python) S 7388 7390 7291 0 -1 4202560 33 108226 0 0 0 0 362313 551 18 0 18 0 657894267 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7519] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7519/stat : 7519 (python) S 7388 7390 7291 0 -1 4202560 32 108226 0 0 0 0 362313 551 18 0 18 0 657894969 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7530] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7530/stat : 7530 (python) S 7388 7390 7291 0 -1 4202560 36 108226 0 0 0 0 362313 551 18 0 18 0 657904690 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7542] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7542/stat : 7542 (python) S 7388 7390 7291 0 -1 4202560 25 108226 0 0 0 0 362313 551 18 0 18 0 657913413 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 5 0 0 0
[pid=7390/tid=7560] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7560/stat : 7560 (python) S 7388 7390 7291 0 -1 4202560 29 108226 0 0 0 0 362313 551 18 0 18 0 657933294 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7565] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7565/stat : 7565 (python) S 7388 7390 7291 0 -1 4202560 28 108226 0 0 0 0 362313 551 18 0 18 0 657934898 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7581] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7581/stat : 7581 (python) S 7388 7390 7291 0 -1 4202560 28 108226 0 0 0 0 362313 551 20 0 18 0 657943214 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7585] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7585/stat : 7585 (python) S 7388 7390 7291 0 -1 4202560 30 108226 0 0 0 0 362313 551 18 0 18 0 657944014 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7592] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7592/stat : 7592 (python) S 7388 7390 7291 0 -1 4202560 31 108226 0 0 0 0 362313 551 20 0 18 0 657953245 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7606] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7606/stat : 7606 (python) S 7388 7390 7291 0 -1 4202560 28 108226 0 0 0 0 362313 551 20 0 18 0 657964703 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7618] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7618/stat : 7618 (python) S 7388 7390 7291 0 -1 4202560 27 108226 0 0 0 0 362313 551 20 0 18 0 657973215 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
[pid=7390/tid=7622] ppid=7388 vsize=484608 CPUtime=3628.64 cores=1,3,5,7
/proc/7390/task/7622/stat : 7622 (python) S 7388 7390 7291 0 -1 4202560 28 108226 0 0 0 0 362313 551 20 0 18 0 657973520 496238592 15096 33554432000 4194304 5683644 140735818228096 18446744073709551615 274485791153 0 0 16781312 2 18446604462371619904 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4375.45
Current children cumulated vsize (KiB) 4851700

Child status: 0
Real time (s): 1105.05
CPU time (s): 4375.66
CPU user time (s): 4368.65
CPU system time (s): 7.01393
CPU usage (%): 395.97
Max. virtual memory (cumulated for all children) (KiB): 12907148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4368.65
system time used= 7.01393
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 191948
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7928
involuntary context switches= 36267

runsolver used 6.32604 second user time and 16.1565 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-15 14:30:46
IDJOB=3378099
IDBENCH=82508
IDSOLVER=1859
FILE ID=node125/3378099-1305462645
RUNJOBID= node125-1305462615-7310
PBS_JOBID= 13324969
Free space on /tmp= 73164 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S883457431-033-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378099-1305462645/watcher-3378099-1305462645 -o /tmp/evaluation-result-3378099-1305462645/solver-3378099-1305462645 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378099-1305462645.cnf -seed 1140004173 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0d0abbf84f73b4226aa3bedf08367d2e
RANDOM SEED=1140004173

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17112132 kB
Buffers:        290588 kB
Cached:        4745156 kB
SwapCached:          0 kB
Active:       11759356 kB
Inactive:      3691620 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17112132 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           43236 kB
Writeback:         180 kB
AnonPages:    10415224 kB
Mapped:          40080 kB
Slab:           281140 kB
PageTables:      42808 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 73975412 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73128 MiB
End job on node125 at 2011-05-15 14:49:11