Trace number 3387024

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)UNSAT 1180.53 1176.52

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S2117313371-002.UNKNOWN.cnf
MD5SUM80ed5c7022fbd1c0bf0af45d87bcb3f8
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark373.874
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.35/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.68	c INFO: solving HOME/instance-3387024-1305596152.cnf
0.35/0.68	c INFO: computing task features
0.42/0.71	c INFO: computed variable-clause graph statistics
0.42/0.72	c INFO: computed clause balance statistics
0.52/0.89	c INFO: computed variable balance statistics
0.62/0.97	c INFO: computed small-clause counts
0.62/0.97	c INFO: computed Horn-clause counts
0.62/0.97	c INFO: computed variable graph statistics
0.62/0.97	c INFO: collected features for HOME/instance-3387024-1305596152.cnf in 0.29 s
0.62/1.00	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.55)
100.35/100.38	c INFO: running gnovelty+2@0 for 97 with 4900 remaining (b = 0.10)
201.04/200.77	c INFO: running adaptg2wsat2009++@0 for 97 with 4800 remaining (b = 0.05)
300.77/300.15	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.03)
400.54/399.53	c INFO: running adaptg2wsat2009++@0 for 97 with 4601 remaining (b = 0.03)
501.27/499.91	c INFO: running gnovelty+2@0 for 97 with 4500 remaining (b = 0.02)
602.02/600.32	c INFO: running FH@0 for 97 with 4400 remaining (b = 0.02)
702.56/700.70	c INFO: running adaptg2wsat2009++@0 for 97 with 4300 remaining (b = 0.01)
802.27/800.09	c INFO: running march_hi@0 for 2134 with 4200 remaining (b = 0.30)
1180.45/1176.50	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3387024-1305596152/watcher-3387024-1305596152 -o /tmp/evaluation-result-3387024-1305596152/solver-3387024-1305596152 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3387024-1305596152.cnf -seed 1767828611 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.06 2.02 2/493 17575
/proc/meminfo: memFree=16611336/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/17575/stat : 17575 (python) R 17573 17575 16405 0 -1 4202496 926 0 0 0 0 0 0 0 23 0 1 0 671214915 16154624 806 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473965568 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17575/statm: 3944 806 356 364 0 431 0

[startup+0.0874309 s]
/proc/loadavg: 2.00 2.06 2.02 2/493 17575
/proc/meminfo: memFree=16611336/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=54540 CPUtime=0.04 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 2071 0 0 0 4 0 0 0 17 0 1 0 671214915 55848960 1828 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 5 0 0 0
/proc/17575/statm: 13635 1828 492 364 0 1285 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 54540

[startup+0.100469 s]
/proc/loadavg: 2.00 2.06 2.02 2/493 17575
/proc/meminfo: memFree=16611336/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=87708 CPUtime=0.06 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 2637 0 0 0 5 1 0 0 17 0 1 0 671214915 89812992 2354 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 5 0 0 0
/proc/17575/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300329 s]
/proc/loadavg: 2.00 2.06 2.02 2/493 17575
/proc/meminfo: memFree=16611336/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=135752 CPUtime=0.18 cores=1,3,5,7
/proc/17575/stat : 17575 (python) R 17573 17575 16405 0 -1 4202496 5974 932 1 0 14 4 0 0 18 0 1 0 671214915 139010048 4149 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473963525 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/17575/statm: 33938 4149 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700256 s]
/proc/loadavg: 2.00 2.06 2.02 2/493 17575
/proc/meminfo: memFree=16611336/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=278916 CPUtime=0.42 cores=1,3,5,7
/proc/17575/stat : 17575 (python) R 17573 17575 16405 0 -1 4202496 9328 932 1 0 31 11 0 0 16 0 1 0 671214915 285609984 6997 33554432000 4194304 5683644 140736477870720 18446744073709551615 4539731 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17575/statm: 69729 6997 1761 364 0 5653 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 278916

[startup+1.50011 s]
/proc/loadavg: 2.00 2.06 2.02 3/494 17580
/proc/meminfo: memFree=16586892/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=289196 CPUtime=0.73 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10017 932 1 0 62 11 0 0 19 0 2 0 671214915 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 72299 7203 1877 364 0 8217 0
[pid=17575/tid=17582] ppid=17573 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 2 0 671215016 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.73
Current children cumulated vsize (KiB) 289196

[startup+3.10083 s]
/proc/loadavg: 2.00 2.06 2.02 3/497 17583
/proc/meminfo: memFree=16584636/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=289196 CPUtime=0.73 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10017 932 1 0 62 11 0 0 19 0 2 0 671214915 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 72299 7203 1877 364 0 8217 0
[pid=17581] ppid=17575 vsize=278952 CPUtime=0 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 671215016 285646848 5676 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987599 0 0 16781312 514 9853916121155993862 0 0 17 5 0 0 0
/proc/17581/statm: 69738 5676 354 364 0 5656 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=2.09 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) R 17581 17583 17583 0 -1 4202496 514 0 0 0 209 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17575/tid=17582] ppid=17573 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 2 0 671215016 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 1586080

[startup+6.30034 s]
/proc/loadavg: 2.00 2.06 2.02 3/497 17583
/proc/meminfo: memFree=16583704/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=289196 CPUtime=0.73 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10017 932 1 0 62 11 0 0 19 0 2 0 671214915 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 72299 7203 1877 364 0 8217 0
[pid=17581] ppid=17575 vsize=278952 CPUtime=0.01 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 886 0 0 0 0 1 0 0 18 0 1 0 671215016 285646848 5699 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987599 0 0 16781312 514 9853916121155993862 0 0 17 5 0 0 0
/proc/17581/statm: 69738 5699 377 364 0 5656 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=5.29 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) R 17581 17583 17583 0 -1 4202496 514 0 0 0 529 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17575/tid=17582] ppid=17573 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 2 0 671215016 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 1586080

[startup+12.7012 s]
/proc/loadavg: 2.00 2.06 2.02 3/497 17583
/proc/meminfo: memFree=16583348/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=289196 CPUtime=0.73 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10017 932 1 0 62 11 0 0 19 0 2 0 671214915 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 72299 7203 1877 364 0 8217 0
[pid=17581] ppid=17575 vsize=278952 CPUtime=0.03 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 890 0 0 0 1 2 0 0 18 0 1 0 671215016 285646848 5699 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987599 0 0 16781312 514 10422209147037516038 0 0 17 5 0 0 0
/proc/17581/statm: 69738 5699 377 364 0 5656 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=11.69 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) R 17581 17583 17583 0 -1 4202496 514 0 0 0 1169 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524546 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17575/tid=17582] ppid=17573 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 2 0 671215016 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 1586080

[startup+25.501 s]
/proc/loadavg: 2.00 2.06 2.02 3/497 17584
/proc/meminfo: memFree=16583748/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=289196 CPUtime=0.73 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10017 932 1 0 62 11 0 0 19 0 2 0 671214915 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 72299 7203 1877 364 0 8217 0
[pid=17581] ppid=17575 vsize=278952 CPUtime=0.08 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 895 0 0 0 4 4 0 0 18 0 1 0 671215016 285646848 5699 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987599 0 0 16781312 514 10422209147037516038 0 0 17 7 0 0 0
/proc/17581/statm: 69738 5699 377 364 0 5656 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=24.49 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) R 17581 17583 17583 0 -1 4202496 514 0 0 0 2449 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17575/tid=17582] ppid=17573 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 2 0 671215016 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.3
Current children cumulated vsize (KiB) 1586080

[startup+51.1004 s]
/proc/loadavg: 2.00 2.05 2.01 3/497 17584
/proc/meminfo: memFree=16583464/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=289196 CPUtime=0.73 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10017 932 1 0 62 11 0 0 19 0 2 0 671214915 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 72299 7203 1877 364 0 8217 0
[pid=17581] ppid=17575 vsize=278952 CPUtime=0.15 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 907 0 0 0 7 8 0 0 18 0 1 0 671215016 285646848 5699 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987599 0 0 16781312 514 10422209147037516038 0 0 17 7 0 0 0
/proc/17581/statm: 69738 5699 377 364 0 5656 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=50.09 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) R 17581 17583 17583 0 -1 4202496 514 0 0 0 5009 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524553 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17575/tid=17582] ppid=17573 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 2 0 671215016 296136704 7203 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 1586080

[startup+102.317 s]
/proc/loadavg: 2.00 2.04 2.01 3/501 17590
/proc/meminfo: memFree=16578568/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=299452 CPUtime=0.76 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10896 932 1 0 64 12 0 0 19 0 3 0 671214915 306638848 7210 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 74863 7210 1880 364 0 10778 0
[pid=17581] ppid=17575 vsize=289196 CPUtime=0.35 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 1084 0 0 0 17 18 0 0 19 0 2 0 671215016 296136704 5737 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17581/statm: 72299 5737 410 364 0 8217 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=99.34 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) T 17581 17583 17583 0 -1 4202496 514 0 0 0 9934 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17581/tid=17587] ppid=17575 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17581/task/17587/stat : 17587 (python) S 17575 17575 16405 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 671224951 296136704 5737 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604463796921472 0 0 -1 7 0 0 0
[pid=17588] ppid=17575 vsize=289208 CPUtime=0 cores=1,3,5,7
/proc/17588/stat : 17588 (python) S 17575 17575 16405 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 671224954 296148992 5674 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987654 0 0 16781312 514 4587835691370512647 0 0 17 5 0 0 0
/proc/17588/statm: 72302 5674 348 364 0 8217 0
[pid=17590] ppid=17588 vsize=1017932 CPUtime=1.92 cores=1,3,5,7
/proc/17590/stat : 17590 (gnovelty+2) R 17588 17590 17590 0 -1 4202496 514 0 0 0 192 0 0 0 25 0 1 0 671224954 1042362368 248 33554432000 134512640 135663704 4287174592 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/17590/statm: 254483 248 113 282 0 254199 0
[pid=17575/tid=17582] ppid=17573 vsize=299452 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 3 0 671215016 306638848 7210 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17589] ppid=17573 vsize=299452 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17589/stat : 17589 (python) S 17573 17575 16405 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 3 0 671224954 306638848 7210 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.37
Current children cumulated vsize (KiB) 2913720

[startup+162.301 s]
/proc/loadavg: 2.00 2.03 2.00 3/501 17591
/proc/meminfo: memFree=16577276/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=299452 CPUtime=0.76 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 10896 932 1 0 64 12 0 0 19 0 3 0 671214915 306638848 7210 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17575/statm: 74863 7210 1880 364 0 10778 0
[pid=17581] ppid=17575 vsize=289196 CPUtime=0.35 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 1084 0 0 0 17 18 0 0 19 0 2 0 671215016 296136704 5737 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17581/statm: 72299 5737 410 364 0 8217 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=99.34 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) T 17581 17583 17583 0 -1 4202496 514 0 0 0 9934 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17581/tid=17587] ppid=17575 vsize=289196 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/17625/statm: 85285 5878 399 364 0 21185 0
[pid=17627] ppid=17625 vsize=246936 CPUtime=100.24 cores=1,3,5,7
/proc/17627/stat : 17627 (FH) T 17625 17627 17627 0 -1 4202496 592 0 0 0 10024 0 0 0 25 0 1 0 671274948 252862464 327 33554432000 134512640 134936988 4291663488 18446744073709551615 134553480 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/17627/statm: 61734 327 41 104 0 61238 0
[pid=17625/tid=17632] ppid=17575 vsize=341140 CPUtime=0 cores=1,3,5,7
/proc/17625/task/17632/stat : 17632 (python) S 17575 17575 16405 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 671284982 349327360 5878 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604460918908224 0 0 -1 7 0 0 0
[pid=17633] ppid=17575 vsize=351396 CPUtime=0.36 cores=1,3,5,7
/proc/17633/stat : 17633 (python) S 17575 17575 16405 0 -1 4202560 1164 0 0 0 18 18 0 0 16 0 2 0 671284986 359829504 5888 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17633/statm: 87849 5888 406 364 0 23746 0
[pid=17635] ppid=17633 vsize=416788 CPUtime=99.34 cores=1,3,5,7
/proc/17635/stat : 17635 (adaptg2wsat2009) T 17633 17635 17635 0 -1 4202496 642 0 0 0 9934 0 0 0 25 0 1 0 671284986 426790912 363 33554432000 134512640 135107411 4289987872 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/17635/statm: 104197 363 59 146 0 103073 0
[pid=17633/tid=17638] ppid=17575 vsize=351396 CPUtime=0 cores=1,3,5,7
/proc/17633/task/17638/stat : 17638 (python) S 17575 17575 16405 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 671294921 359829504 5888 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604454244749440 0 0 -1 7 0 0 0
[pid=17639] ppid=17575 vsize=361080 CPUtime=1.53 cores=1,3,5,7
/proc/17639/stat : 17639 (python) S 17575 17575 16405 0 -1 4202560 1033 0 0 0 80 73 0 0 15 0 1 0 671294925 369745920 5736 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987654 0 0 16781312 514 3767472198822887685 0 0 17 7 0 0 0
/proc/17639/statm: 90270 5736 372 364 0 26164 0
[pid=17641] ppid=17639 vsize=3932 CPUtime=375.82 cores=1,3,5,7
/proc/17641/stat : 17641 (march_hi) R 17639 17641 17641 0 -1 4202496 1702 0 0 0 37582 0 0 0 25 0 1 0 671294926 4026368 798 33554432000 4194304 4955518 140737099268224 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/17641/statm: 983 798 106 186 0 796 0
[pid=17575/tid=17582] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 10 0 671215016 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17589] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17589/stat : 17589 (python) S 17573 17575 16405 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 10 0 671224954 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17595] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17595/stat : 17595 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 671234993 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 7 0 0 0
[pid=17575/tid=17602] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17602/stat : 17602 (python) S 17573 17575 16405 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 10 0 671244931 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17609] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17609/stat : 17609 (python) S 17573 17575 16405 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 10 0 671254869 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17615] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17615/stat : 17615 (python) S 17573 17575 16405 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 10 0 671264907 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17626] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17626/stat : 17626 (python) S 17573 17575 16405 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 10 0 671274948 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17634] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17634/stat : 17634 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 671284986 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17640] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17640/stat : 17640 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 671294925 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1179.74
Current children cumulated vsize (KiB) 8236000

[startup+1176.3 s]
/proc/loadavg: 2.00 2.04 2.00 3/534 17651
/proc/meminfo: memFree=16438076/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=371324 CPUtime=1 cores=1,3,5,7
/proc/17575/stat : 17575 (python) S 17573 17575 16405 0 -1 4202496 17111 932 1 0 87 13 0 0 19 0 10 0 671214915 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/17575/statm: 92831 7262 1894 364 0 28725 0
[pid=17581] ppid=17575 vsize=289196 CPUtime=0.35 cores=1,3,5,7
/proc/17581/stat : 17581 (python) S 17575 17575 16405 0 -1 4202560 1084 0 0 0 17 18 0 0 19 0 2 0 671215016 296136704 5737 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17581/statm: 72299 5737 410 364 0 8217 0
[pid=17583] ppid=17581 vsize=1017932 CPUtime=99.34 cores=1,3,5,7
/proc/17583/stat : 17583 (gnovelty+2) T 17581 17583 17583 0 -1 4202496 514 0 0 0 9934 0 0 0 25 0 1 0 671215016 1042362368 247 33554432000 134512640 135663704 4291433168 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/17583/statm: 254483 247 113 282 0 254199 0
[pid=17581/tid=17587] ppid=17575 vsize=289196 CPUtime=0 cores=1,3,5,7
/proc/17581/task/17587/stat : 17587 (python) S 17575 17575 16405 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 671224951 296136704 5737 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604463796921472 0 0 -1 7 0 0 0
[pid=17588] ppid=17575 vsize=289208 CPUtime=0.35 cores=1,3,5,7
/proc/17588/stat : 17588 (python) S 17575 17575 16405 0 -1 4202560 1080 0 0 0 20 15 0 0 19 0 2 0 671224954 296148992 5727 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17588/statm: 72302 5727 400 364 0 8217 0
[pid=17590] ppid=17588 vsize=1017932 CPUtime=100.29 cores=1,3,5,7
/proc/17590/stat : 17590 (gnovelty+2) T 17588 17590 17590 0 -1 4202496 514 0 0 0 10029 0 0 0 25 0 1 0 671224954 1042362368 248 33554432000 134512640 135663704 4287174592 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/17590/statm: 254483 248 113 282 0 254199 0
[pid=17588/tid=17593] ppid=17575 vsize=289208 CPUtime=0 cores=1,3,5,7
/proc/17588/task/17593/stat : 17593 (python) S 17575 17575 16405 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 671234989 296148992 5727 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604471160751168 0 0 -1 7 0 0 0
[pid=17594] ppid=17575 vsize=299740 CPUtime=0.35 cores=1,3,5,7
/proc/17594/stat : 17594 (python) S 17575 17575 16405 0 -1 4202560 1090 0 0 0 19 16 0 0 19 0 2 0 671234992 306933760 5768 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17594/statm: 74935 5768 400 364 0 10847 0
[pid=17596] ppid=17594 vsize=416788 CPUtime=99.34 cores=1,3,5,7
/proc/17596/stat : 17596 (adaptg2wsat2009) T 17594 17596 17596 0 -1 4202496 631 0 0 0 9934 0 0 0 25 0 1 0 671234993 426790912 365 33554432000 134512640 135107411 4291575920 18446744073709551615 134532288 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/17596/statm: 104197 365 59 146 0 103073 0
[pid=17594/tid=17600] ppid=17575 vsize=299740 CPUtime=0 cores=1,3,5,7
/proc/17594/task/17600/stat : 17600 (python) S 17575 17575 16405 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 671244927 306933760 5768 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604461452195008 0 0 -1 3 0 0 0
[pid=17601] ppid=17575 vsize=309996 CPUtime=0.35 cores=1,3,5,7
/proc/17601/stat : 17601 (python) S 17575 17575 16405 0 -1 4202560 1095 0 0 0 18 17 0 0 16 0 2 0 671244931 317435904 5793 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17601/statm: 77499 5793 400 364 0 13408 0
[pid=17603] ppid=17601 vsize=416788 CPUtime=99.34 cores=1,3,5,7
/proc/17603/stat : 17603 (adaptg2wsat2009) T 17601 17603 17603 0 -1 4202496 631 0 0 0 9934 0 0 0 25 0 1 0 671244931 426790912 363 33554432000 134512640 135107411 4293428912 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/17603/statm: 104197 363 59 146 0 103073 0
[pid=17601/tid=17607] ppid=17575 vsize=309996 CPUtime=0 cores=1,3,5,7
/proc/17601/task/17607/stat : 17607 (python) S 17575 17575 16405 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 671254865 317435904 5793 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604455769715648 0 0 -1 7 0 0 0
[pid=17608] ppid=17575 vsize=320424 CPUtime=0.35 cores=1,3,5,7
/proc/17608/stat : 17608 (python) S 17575 17575 16405 0 -1 4202560 1108 0 0 0 18 17 0 0 19 0 2 0 671254869 328114176 5819 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17608/statm: 80106 5819 400 364 0 16012 0
[pid=17610] ppid=17608 vsize=416788 CPUtime=100.34 cores=1,3,5,7
/proc/17610/stat : 17610 (adaptg2wsat2009) T 17608 17610 17610 0 -1 4202496 632 0 0 0 10034 0 0 0 25 0 1 0 671254869 426790912 362 33554432000 134512640 135107411 4289476864 18446744073709551615 134532242 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/17610/statm: 104197 362 59 146 0 103073 0
[pid=17608/tid=17613] ppid=17575 vsize=320424 CPUtime=0 cores=1,3,5,7
/proc/17608/task/17613/stat : 17613 (python) S 17575 17575 16405 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 671264903 328114176 5819 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604454553011456 0 0 -1 7 0 0 0
[pid=17614] ppid=17575 vsize=330680 CPUtime=0.35 cores=1,3,5,7
/proc/17614/stat : 17614 (python) S 17575 17575 16405 0 -1 4202560 1116 0 0 0 18 17 0 0 19 0 2 0 671264907 338616320 5848 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/17614/statm: 82670 5848 400 364 0 18573 0
[pid=17616] ppid=17614 vsize=1017932 CPUtime=100.36 cores=1,3,5,7
/proc/17616/stat : 17616 (gnovelty+2) T 17614 17616 17616 0 -1 4202496 514 0 0 0 10036 0 0 0 25 0 1 0 671264907 1042362368 247 33554432000 134512640 135663704 4292329728 18446744073709551615 134524868 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/17616/statm: 254483 247 113 282 0 254199 0
[pid=17614/tid=17624] ppid=17575 vsize=330680 CPUtime=0 cores=1,3,5,7
/proc/17614/task/17624/stat : 17624 (python) S 17575 17575 16405 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 671274944 338616320 5848 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604459509362752 0 0 -1 7 0 0 0
[pid=17625] ppid=17575 vsize=341140 CPUtime=0.34 cores=1,3,5,7
/proc/17625/stat : 17625 (python) S 17575 17575 16405 0 -1 4202560 1108 0 0 0 19 15 0 0 19 0 2 0 671274948 349327360 5878 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/17625/statm: 85285 5878 399 364 0 21185 0
[pid=17627] ppid=17625 vsize=246936 CPUtime=100.24 cores=1,3,5,7
/proc/17627/stat : 17627 (FH) T 17625 17627 17627 0 -1 4202496 592 0 0 0 10024 0 0 0 25 0 1 0 671274948 252862464 327 33554432000 134512640 134936988 4291663488 18446744073709551615 134553480 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/17627/statm: 61734 327 41 104 0 61238 0
[pid=17625/tid=17632] ppid=17575 vsize=341140 CPUtime=0 cores=1,3,5,7
/proc/17625/task/17632/stat : 17632 (python) S 17575 17575 16405 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 671284982 349327360 5878 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604460918908224 0 0 -1 7 0 0 0
[pid=17633] ppid=17575 vsize=351396 CPUtime=0.36 cores=1,3,5,7
/proc/17633/stat : 17633 (python) S 17575 17575 16405 0 -1 4202560 1164 0 0 0 18 18 0 0 16 0 2 0 671284986 359829504 5888 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/17633/statm: 87849 5888 406 364 0 23746 0
[pid=17635] ppid=17633 vsize=416788 CPUtime=99.34 cores=1,3,5,7
/proc/17635/stat : 17635 (adaptg2wsat2009) T 17633 17635 17635 0 -1 4202496 642 0 0 0 9934 0 0 0 25 0 1 0 671284986 426790912 363 33554432000 134512640 135107411 4289987872 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/17635/statm: 104197 363 59 146 0 103073 0
[pid=17633/tid=17638] ppid=17575 vsize=351396 CPUtime=0 cores=1,3,5,7
/proc/17633/task/17638/stat : 17638 (python) S 17575 17575 16405 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 671294921 359829504 5888 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 514 18446604454244749440 0 0 -1 7 0 0 0
[pid=17639] ppid=17575 vsize=361080 CPUtime=1.53 cores=1,3,5,7
/proc/17639/stat : 17639 (python) S 17575 17575 16405 0 -1 4202560 1035 0 0 0 80 73 0 0 15 0 1 0 671294925 369745920 5736 33554432000 4194304 5683644 140736477870720 18446744073709551615 274473987654 0 0 16781312 514 3767472198822887685 0 0 17 7 0 0 0
/proc/17639/statm: 90270 5736 372 364 0 26164 0
[pid=17641] ppid=17639 vsize=4696 CPUtime=376.2 cores=1,3,5,7
/proc/17641/stat : 17641 (march_hi) R 17639 17641 17641 0 -1 4202496 1703 0 0 0 37620 0 0 0 25 0 1 0 671294926 4808704 799 33554432000 4194304 4955518 140737099268224 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/17641/statm: 1174 799 106 186 0 987 0
[pid=17575/tid=17582] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 10 0 671215016 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17589] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17589/stat : 17589 (python) S 17573 17575 16405 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 10 0 671224954 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17595] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17595/stat : 17595 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 671234993 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 7 0 0 0
[pid=17575/tid=17602] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17602/stat : 17602 (python) S 17573 17575 16405 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 10 0 671244931 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17609] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17609/stat : 17609 (python) S 17573 17575 16405 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 10 0 671254869 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17615] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17615/stat : 17615 (python) S 17573 17575 16405 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 10 0 671264907 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17626] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17626/stat : 17626 (python) S 17573 17575 16405 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 10 0 671274948 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17634] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17634/stat : 17634 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 671284986 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17640] ppid=17573 vsize=371324 CPUtime=0 cores=1,3,5,7
/proc/17575/task/17640/stat : 17640 (python) S 17573 17575 16405 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 671294925 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1180.12
Current children cumulated vsize (KiB) 8236764

[startup+1176.5 s]
/proc/loadavg: 2.00 2.04 2.00 3/534 17651
/proc/meminfo: memFree=16438076/32950928 swapFree=67042944/67111528
[pid=17575] ppid=17573 vsize=371324 CPUtime=702.83 cores=1,3,5,7
/proc/17575/stat : 17575 (python) R 17573 17575 16405 0 -1 4202496 17164 12886 1 0 87 13 70062 121 17 0 10 0 671214915 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485797695 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17575/statm: 92831 7262 1894 364 0 28725 0
[pid=17633] ppid=17575 vsize=0 CPUtime=99.7 cores=1,3,5,7
/proc/17633/stat : 17633 (python) Z 17575 17575 16405 0 -1 4202588 1198 642 0 0 18 18 9934 0 16 0 1 0 671284986 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17633/statm: 0 0 0 0 0 0 0
[pid=17639] ppid=17575 vsize=0 CPUtime=377.92 cores=1,3,5,7
/proc/17639/stat : 17639 (python) Z 17575 17575 16405 0 -1 4202588 1265 1704 0 0 80 73 37639 0 15 0 1 0 671294925 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17639/statm: 0 0 0 0 0 0 0
[pid=17575/tid=17582] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17582/stat : 17582 (python) S 17573 17575 16405 0 -1 4202560 29 12886 0 0 0 0 70062 121 19 0 10 0 671215016 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17589] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17589/stat : 17589 (python) S 17573 17575 16405 0 -1 4202560 26 12886 0 0 0 0 70062 121 20 0 10 0 671224954 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 5 0 0 0
[pid=17575/tid=17595] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17595/stat : 17595 (python) S 17573 17575 16405 0 -1 4202560 29 12886 0 0 0 0 70062 121 20 0 10 0 671234993 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 7 0 0 0
[pid=17575/tid=17602] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17602/stat : 17602 (python) S 17573 17575 16405 0 -1 4202560 27 12886 0 0 0 0 70062 121 20 0 10 0 671244931 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17609] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17609/stat : 17609 (python) S 17573 17575 16405 0 -1 4202560 30 12886 0 0 0 0 70062 121 20 0 10 0 671254869 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17615] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17615/stat : 17615 (python) S 17573 17575 16405 0 -1 4202560 28 12886 0 0 0 0 70062 121 20 0 10 0 671264907 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17626] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17626/stat : 17626 (python) S 17573 17575 16405 0 -1 4202560 28 12886 0 0 0 0 70062 121 20 0 10 0 671274948 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17634] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17634/stat : 17634 (python) S 17573 17575 16405 0 -1 4202560 29 12886 0 0 0 0 70062 121 20 0 10 0 671284986 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
[pid=17575/tid=17640] ppid=17573 vsize=371324 CPUtime=701.83 cores=1,3,5,7
/proc/17575/task/17640/stat : 17640 (python) S 17573 17575 16405 0 -1 4202560 29 12886 0 0 0 0 70062 121 20 0 10 0 671294925 380235776 7262 33554432000 4194304 5683644 140736477870720 18446744073709551615 274485791153 0 0 16781312 2 18446604468876515520 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1180.45
Current children cumulated vsize (KiB) 371324

Child status: 0
Real time (s): 1176.52
CPU time (s): 1180.53
CPU user time (s): 1178.25
CPU system time (s): 2.28565
CPU usage (%): 100.341
Max. virtual memory (cumulated for all children) (KiB): 8236764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1178.25
system time used= 2.28565
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 39222
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4980
involuntary context switches= 2162

runsolver used 7.02993 second user time and 15.0677 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-17 03:35:52
IDJOB=3387024
IDBENCH=83089
IDSOLVER=1872
FILE ID=node125/3387024-1305596152
RUNJOBID= node125-1305586146-16424
PBS_JOBID= 13350353
Free space on /tmp= 73156 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S2117313371-002.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3387024-1305596152/watcher-3387024-1305596152 -o /tmp/evaluation-result-3387024-1305596152/solver-3387024-1305596152 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3387024-1305596152.cnf -seed 1767828611 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 80ed5c7022fbd1c0bf0af45d87bcb3f8
RANDOM SEED=1767828611

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16611616 kB
Buffers:        220872 kB
Cached:        2023308 kB
SwapCached:      55652 kB
Active:        9031808 kB
Inactive:      6953348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16611616 kB
SwapTotal:    67111528 kB
SwapFree:     67042944 kB
Dirty:           31912 kB
Writeback:           0 kB
AnonPages:    13685180 kB
Mapped:          48928 kB
Slab:           219316 kB
PageTables:      66500 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 130598552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73124 MiB
End job on node125 at 2011-05-17 03:55:29