Difference between revisions of "PDR.PODM Distributed Memory"

From crtc.cs.odu.edu
Jump to: navigation, search
(15 MPI ranks depth = 3)
(Latest Results)
 
(69 intermediate revisions by the same user not shown)
Line 31: Line 31:
  
 
= Interesting Findings =
 
= Interesting Findings =
 
+
== Delta 0.880 ==
 
=== 15 MPI ranks depth: 3 ===
 
=== 15 MPI ranks depth: 3 ===
 +
<div class="mw-collapsible mw-collapsed">
  
[[File:PDR PODM Parallelism.png| 700px]]
 
[[File:PDR_PODM_Histogram_15.png| 700px]]
 
  
  
polling_times[1] = 62.977124
+
[[File:PDR PODM Histogram Time 15 d3.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 15 d3.png| 700px]]
 +
[[File:PDR PODM Time Break Down 15 d3.png| 700px]]
  
polling_times[2] = 81.895647
+
[[File:PDR PODM Parallelism.png| 700px]]
 +
[[File:PDR_PODM_Histogram_15.png| 700px]]
 +
</div>
  
polling_times[3] = 79.853833
+
=== 15 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
  
polling_times[4] = 121.689584
 
  
polling_times[5] = 67.187857
 
  
polling_times[6] = 77.674953
+
[[File:PDR PODM Histogram Time 15.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 15.png| 700px]]
 +
[[File:PDR PODM Time Break Down 15.png| 700px]]
  
polling_times[7] = 110.503308
+
</div>
  
polling_times[8] = 63.927371
+
=== 40 MPI ranks / 40 cores depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total Time: 824.29
  
polling_times[9] = 63.174693
+
Total Tasks: 11413
  
polling_times[10] = 77.656739
+
[[File:PDR PODM Histogram Time 40.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 40.png| 700px]]
 +
[[File:PDR PODM Time Break Down 40.png| 700px]]
 +
</div>
  
polling_times[11] = 84.785231
+
=== 160 MPI ranks / 10 cores depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total Time: 378.32
  
polling_times[12] = 86.950730
+
Total Tasks: 12652
  
polling_times[13] = 67.230592
+
[[File:PDR PODM Histogram Time 160 10.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 160 10.png| 700px]]
 +
[[File:PDR PODM Time Break Down 160 10.png| 700px]]
 +
</div>
  
polling_times[14] = 70.842911
+
== After Parallel int to pointer ==
 +
=== 15 MPI ranks depth: 3 ===
 +
<div class="mw-collapsible mw-collapsed">
  
int_to_pointer_times[1] = 413.575395
 
  
int_to_pointer_times[2] = 393.641700
+
[[File:PDR PODM Histogram Time 15 d3 par int2ptr.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 15 d3 par int2ptr.png| 700px]]
  
int_to_pointer_times[3] = 436.249681
 
  
int_to_pointer_times[4] = 388.363599
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_15_d3.png| 700px]]
 +
| [[File:PDR PODM Time Break Down 15 d3 par int2ptr.png| 700px]]
 +
|}
  
int_to_pointer_times[5] = 454.809466
+
</div>
  
int_to_pointer_times[6] = 464.654607
+
=== 15 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total time: 569.7
  
int_to_pointer_times[7] = 451.311534
+
Total tasks: 8761
  
int_to_pointer_times[8] = 417.156188
+
[[File:PDR PODM Histogram Time 15 par int2ptr.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 15 par int2ptr.png| 700px]]
  
int_to_pointer_times[9] = 458.370492
 
  
int_to_pointer_times[10] = 443.813062
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_15.png| 700px]]
 +
| [[File:PDR PODM Time Break Down 15 par int2ptr.png| 700px]]
 +
|}
  
int_to_pointer_times[11] = 466.672172
+
</div>
  
int_to_pointer_times[12] = 405.445182
+
=== 40 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total time: 326.5
  
int_to_pointer_times[13] = 466.928191
+
Total tasks: 11201
  
int_to_pointer_times[14] = 427.620845
+
[[File:PDR PODM Histogram Time 40 par int2ptr.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 40 par int2ptr.png| 700px]]
  
clear_element_lists_times[1] = 0.000762
 
  
clear_element_lists_times[2] = 0.000687
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_40.png| 700px]]
 +
| [[File:PDR PODM Time Break Down 40 par int2ptr.png| 700px]]
 +
|}
  
clear_element_lists_times[3] = 0.000647
+
</div>
  
clear_element_lists_times[4] = 0.000621
+
=== 160 MPI ranks 10 cores depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total time: 264.3
  
clear_element_lists_times[5] = 0.000627
+
Total tasks: 12826
  
clear_element_lists_times[6] = 0.000670
+
[[File:PDR PODM Histogram Time 160 10 par int2ptr.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 160 10 par int2ptr.png| 700px]]
  
clear_element_lists_times[7] = 0.000724
 
  
clear_element_lists_times[8] = 0.000560
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_160_10.png| 700px]]
 +
| [[File:PDR PODM Time Break Down 160 10 par int2ptr.png| 700px]]
 +
|}
  
clear_element_lists_times[9] = 0.000868
+
</div>
  
clear_element_lists_times[10] = 0.002675
+
== After Parallel int to pointer and leaf distribution ==
 +
=== 15 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total time: 452.3
  
clear_element_lists_times[11] = 0.000628
+
Total tasks: 8813
  
clear_element_lists_times[12] = 0.000851
+
[[File:PDR PODM Histogram Time 15 par int2ptr leaf dist bad elements.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 15 par int2ptr leaf dist bad elements.png| 700px]]
  
clear_element_lists_times[13] = 0.001053
 
  
clear_element_lists_times[14] = 0.001273
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(int2ptr)
 +
! Parallel(leafDist,BadEl)
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_15.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 15 par int2ptr.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 15 par int2ptr leaf dist bad elements.png| 500px]]
 +
|}
  
polling_all_times[1] = 140.294989
+
</div>
  
polling_all_times[2] = 171.339134
+
=== 40 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total time: 271.9
  
polling_all_times[3] = 158.837717
+
Total tasks: 11455
  
polling_all_times[4] = 230.522151
+
[[File:PDR PODM Histogram Time 40 par int2ptr leaf dist bad elements.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks 40 par int2ptr leaf dist bad elements.png| 700px]]
  
polling_all_times[5] = 151.359351
 
  
polling_all_times[6] = 168.926307
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(int2ptr)
 +
! Parallel(leafDist,BadEl)
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_40.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 40 par int2ptr.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 40 par int2ptr leaf dist bad elements.png| 500px]]
 +
|}
  
polling_all_times[7] = 236.011997
+
</div>
  
polling_all_times[8] = 145.662843
+
=== 160 MPI ranks 10 cores depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
 +
Total time: 218.3
  
polling_all_times[9] = 159.411167
+
Total tasks: 12517
  
polling_all_times[10] = 171.122498
+
[[File:PDR PODM Histogram Time 160 10 par int2ptr leaf dist bad elements.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 160 10 par int2ptr leaf dist bad elements.png| 700px]]
  
polling_all_times[11] = 194.755214
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(int2ptr)
 +
! Parallel(leafDist,BadEl)
 +
|-
 +
| [[File:PDR PODM Time Break Down 160 10.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 160 10 par int2ptr.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 160 10 par int2ptr leaf dist bad elements.png| 500px]]
 +
|}
 +
</div>
  
polling_all_times[12] = 186.417060
+
== After Parallel int to pointer, leaf distribution and extra comm thread ==
 +
=== 15 MPI ranks depth: 3 ===
 +
<div class="mw-collapsible mw-collapsed">
  
polling_all_times[13] = 152.213076
+
Total time: 1144.7
  
polling_all_times[14] = 162.141306
+
Total tasks: 1830
  
wait_in_queue_times1[1] = 2027.081317
+
[[File:PDR PODM Histogram Time 15 d3 par int2ptr leaf dist bad elements comm thread.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 15 d3 par int2ptr leaf dist bad elements comm thread.png| 700px]]
  
wait_in_queue_times1[2] = 2004.238402
 
  
wait_in_queue_times1[3] = 2078.419998
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(best)
 +
! Parallel(best+comm_thread)
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_15_d3.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 15 d3 par int2ptr leaf dist bad elements.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 15 d3 par int2ptr leaf dist bad elements comm thread.png| 500px]]
  
wait_in_queue_times1[4] = 2007.550366
+
|}
  
wait_in_queue_times1[5] = 1986.886886
+
</div>
  
wait_in_queue_times1[6] = 1951.253771
+
=== 15 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
  
wait_in_queue_times1[7] = 1942.383973
+
Total time: 354.6
  
wait_in_queue_times1[8] = 2005.419375
+
Total tasks: 8892
  
wait_in_queue_times1[9] = 1997.842771
+
[[File:PDR PODM Histogram Time 15 par int2ptr leaf dist bad elements comm thread.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 15 par int2ptr leaf dist bad elements comm thread.png| 700px]]
  
wait_in_queue_times1[10] = 1997.673105
 
  
wait_in_queue_times1[11] = 2000.956408
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(best)
 +
! Parallel(best+comm_thread)
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_15.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 15 par int2ptr leaf dist bad elements.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 15 par int2ptr leaf dist bad elements comm thread.png| 500px]]
  
wait_in_queue_times1[12] = 1974.561631
+
|}
  
wait_in_queue_times1[13] = 1979.973832
+
</div>
  
wait_in_queue_times1[14] = 2072.972642
+
=== 40 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
  
wait_in_queue_times2[1] = 3162.564690
+
Total time: 208.3
  
wait_in_queue_times2[2] = 3152.861625
+
Total tasks: 11468
  
wait_in_queue_times2[3] = 3103.681840
 
  
wait_in_queue_times2[4] = 3093.594562
+
[[File:PDR PODM Histogram Time 40 par int2ptr leaf dist bad elements comm thread.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 40 par int2ptr leaf dist bad elements comm thread.png| 700px]]
  
wait_in_queue_times2[5] = 3094.828513
 
  
wait_in_queue_times2[6] = 3068.933678
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(best)
 +
! Parallel(best+comm_thread)
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_40.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 40 par int2ptr leaf dist bad elements.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 40 par int2ptr leaf dist bad elements comm thread.png| 500px]]
  
wait_in_queue_times2[7] = 3007.889167
+
|}
  
wait_in_queue_times2[8] = 3148.827740
+
</div>
  
wait_in_queue_times2[9] = 3080.482366
+
=== 160 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
  
wait_in_queue_times2[10] = 3088.332840
+
Total time: 202.2
  
wait_in_queue_times2[11] = 3042.559130
+
Total tasks: 12715
  
wait_in_queue_times2[12] = 3121.678383
 
  
wait_in_queue_times2[13] = 3079.916276
+
[[File:PDR PODM Histogram Time 160 10 par int2ptr leaf dist bad elements comm thread.png| 700px]]
 +
[[File:PDR PODM Histrogram Tasks 160 10 par int2ptr leaf dist bad elements comm thread.png| 700px]]
  
wait_in_queue_times2[14] = 3124.285036
 
  
mesher_elements[1] = 2288798
+
{| class="wikitable" style="text-align: center;
 +
! Sequential
 +
! Parallel(best)
 +
! Parallel(best+comm_thread)
 +
|-
 +
| [[File:PDR_PODM_Time_Break_Down_160_10.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 160 10 par int2ptr leaf dist bad elements.png| 500px]]
 +
| [[File:PDR PODM Time Break Down 160 10 par int2ptr leaf dist bad elements comm thread.png| 500px]]
  
mesher_elements[2] = 2536028
+
|}
  
mesher_elements[3] = 2709194
+
</div>
  
mesher_elements[4] = 4263686
+
== Delta 0.3780 ==
 +
=== 15 MPI ranks depth: 4 ===
 +
<div class="mw-collapsible mw-collapsed">
  
mesher_elements[5] = 2157859
 
  
mesher_elements[6] = 3134463
 
  
mesher_elements[7] = 4804167
+
[[File:PDR PODM Histogram Time small_delta 15.png| 700px]]
 +
[[File:PDR PODM Histogram Tasks small_delta 15.png| 700px]]
 +
[[File:PDR PODM Time Break Down small_delta 15.png| 700px]]
  
mesher_elements[8] = 1975299
+
</div>
  
mesher_elements[9] = 2373811
 
  
mesher_elements[10] = 2721700
+
=== Latest Results ===
  
mesher_elements[11] = 1998762
+
{| class="wikitable"
 
+
|+ Shared MemoryTimes
mesher_elements[12] = 2323134
+
|-
 
+
! Cores !! Total Time (s) !! Number of Elements
mesher_elements[13] = 4775266
+
|-
 
+
| 40|| 90.8 || 49453719
mesher_elements[14] = 2789597
+
|-
 
+
|}
meshing_times[1] = 36.443444
 
 
 
meshing_times[2] = 37.558417
 
 
 
meshing_times[3] = 45.448564
 
 
 
meshing_times[4] = 40.453400
 
 
 
meshing_times[5] = 43.791719
 
 
 
meshing_times[6] = 40.182756
 
 
 
meshing_times[7] = 44.701021
 
 
 
meshing_times[8] = 39.561876
 
 
 
meshing_times[9] = 47.492666
 
 
 
meshing_times[10] = 46.783555
 
 
 
meshing_times[11] = 40.445111
 
 
 
meshing_times[12] = 39.889953
 
 
 
meshing_times[13] = 47.444813
 
 
 
meshing_times[14] = 35.083527
 
 
 
leaf_distribution_time[1] = 72.064785
 
 
 
leaf_distribution_time[2] = 67.755446
 
 
 
leaf_distribution_time[3] = 78.394198
 
 
 
leaf_distribution_time[4] = 72.630350
 
 
 
leaf_distribution_time[5] = 77.081779
 
 
 
leaf_distribution_time[6] = 78.999842
 
 
 
leaf_distribution_time[7] = 77.059384
 
  
leaf_distribution_time[8] = 72.617468
 
  
leaf_distribution_time[9] = 69.875876
 
 
leaf_distribution_time[10] = 71.842582
 
 
leaf_distribution_time[11] = 73.979892
 
 
leaf_distribution_time[12] = 71.419246
 
 
leaf_distribution_time[13] = 72.170305
 
 
leaf_distribution_time[14] = 72.779034
 
 
 
total_num_mesher_elements = 43167663
 
 
initial_number_of_elements = 2315899
 
 
initial_io_time = 9.116445
 
 
initial_allocation_time = 0.004795
 
 
initial_meshing_time = 3.937135
 
 
initial_mesh_distribution_time = 2.665803
 
 
get_leaf_elements_time = 0.331813
 
 
pointer_to_int_time = 0.138809
 
 
pack_data_time = 0.064877
 
 
send_data_time = 0.191445
 
 
sub_total_time = 3831.977334
 
 
max_meshing_time = 47.492666
 
 
max_io_time = 9.596057
 
 
max_allocation_time = 9.961161
 
 
max_recv_time = 0.000000
 
 
max_polling_time = 121.689584
 
 
max_int_to_pointer_time = 466.928191
 
 
max_clear_element_lists_time = 0.002675
 
 
max_polling_all_time = 236.011997
 
 
max_wait_in_queue_time1 = 2078.419998
 
 
max_wait_in_queue_time2 = 3162.564690
 
 
elements_per_second = 7311014.065501
 
 
elements_per_second1 = 588219.279339
 
 
elements_per_second2 = 20765032.278210
 
 
master_idle_time = 3831.174962
 
 
surface_box_time = 9.046863
 
 
edt_time = 0.566338
 
 
octree_time = 0.122400
 
 
 
* How many times migrated a leaf (main and neighbor) ?
 
* How many times a leaf is scheduled ? (as main leaf)
 
* Packed size for each transmission (MB)/time?
 
* Meshing time each time it was main
 
* Initial meshing time
 
* Per process :
 
** Meshing
 
** Preprocessing (pack/unpack)
 
** waiting time
 
* Waiting time per process ?
 
* Elements before and after each time it was used (main/neighbor) ?
 
  
 
{| class="wikitable"
 
{| class="wikitable"
! leaf_id || init elements || num_migrations || num_scheduled || num_refined ||  max_size_migration (KB) || min_size_migration (KB) || avg_size_migration (KB) ||  max_time_migration (sec) || min_time_migration (sec) || avg_time_migration (sec)
+
|+ MPI Times
|-
 
| 0 || 5140 || 1 || 0 || 1
 
|-
 
| 1 || 4921 || 1 || 0 || 1
 
|-
 
| 2 || 4880 || 1 || 0 || 1
 
|-
 
| 3 || 4714 || 1 || 0 || 1
 
|-
 
| 4 || 5044 || 1 || 0 || 1
 
|-
 
| 5 || 4668 || 1 || 0 || 1
 
|-
 
| 6 || 4741 || 1 || 0 || 1
 
|-
 
| 7 || 4470 || 1 || 1 || 0
 
|-
 
| 8 || 4854 || 1 || 0 || 1
 
|-
 
| 9 || 4733 || 1 || 0 || 1
 
|-
 
| 10 || 4628 || 1 || 0 || 1
 
|-
 
| 11 || 4719 || 1 || 0 || 1
 
|-
 
| 12 || 4747 || 1 || 0 || 1
 
|-
 
| 13 || 4692 || 1 || 0 || 1
 
|-
 
| 14 || 4484 || 1 || 0 || 1
 
|-
 
| 15 || 4439 || 1 || 0 || 1
 
|-
 
| 16 || 4847 || 2 || 0 || 2 || 415 || 415 || 415.0 || 0.000405 || 0.000405 || 0.000405
 
|-
 
| 17 || 4597 || 6 || 0 || 6 || 394 || 394 || 394.0 || 0.015056 || 0.000377 || 0.003564199999999999
 
|-
 
| 18 || 4875 || 4 || 0 || 4 || 417 || 417 || 417.0 || 0.030162 || 0.000719 || 0.016067
 
|-
 
| 19 || 4704 || 9 || 0 || 9 || 405 || 404 || 404.0 || 0.019694 || 0.000544 || 0.007640875
 
|-
 
| 20 || 4611 || 2 || 0 || 2 || 395 || 395 || 395.0 || 0.000401 || 0.000401 || 0.000401
 
|-
 
| 21 || 4515 || 10 || 0 || 10 || 387 || 387 || 387.0 || 0.023126 || 0.000373 || 0.0037203333333333324
 
|-
 
| 22 || 4715 || 7 || 0 || 7 || 404 || 404 || 404.0 || 0.016818 || 0.000444 || 0.006300166666666667
 
|-
 
| 23 || 4557 || 21 || 1 || 20 || 403 || 394 || 400.0 || 0.04192 || 0.000398 || 0.01055885
 
|-
 
| 24 || 4570 || 10 || 0 || 10 || 392 || 392 || 392.0 || 0.030502 || 0.000373 || 0.00599111111111111
 
|-
 
| 25 || 4666 || 13 || 0 || 13 || 400 || 400 || 400.0 || 0.047174 || 0.00068 || 0.01136525
 
|-
 
| 26 || 4746 || 15 || 0 || 15 || 531 || 407 || 510.0 || 0.049097 || 0.00055 || 0.00914507142857143
 
|-
 
| 27 || 4868 || 17 || 0 || 17 || 621 || 417 || 593.0 || 0.052032 || 0.000761 || 0.014502000000000001
 
|-
 
| 28 || 4481 || 19 || 0 || 19 || 384 || 384 || 384.0 || 0.019985 || 0.000293 || 0.0026930555555555557
 
|-
 
| 29 || 4509 || 26 || 0 || 26 || 387 || 387 || 387.0 || 0.034138 || 0.000437 || 0.006108079999999999
 
|-
 
| 30 || 4590 || 34 || 4 || 30 || 10613 || 395 || 8870.0 || 1.144701 || 0.000322 || 0.13719339393939395
 
|-
 
| 31 || 4752 || 39 || 4 || 35 || 20063 || 415 || 15899.0 || 2.210566 || 0.000639 || 0.17472076315789475
 
|-
 
| 32 || 4904 || 1 || 0 || 1
 
|-
 
| 33 || 4767 || 1 || 0 || 1
 
|-
 
| 34 || 4667 || 1 || 0 || 1
 
|-
 
| 35 || 4510 || 1 || 0 || 1
 
|-
 
| 36 || 4929 || 1 || 0 || 1
 
|-
 
| 37 || 4771 || 1 || 0 || 1
 
|-
 
| 38 || 4754 || 1 || 0 || 1
 
|-
 
| 39 || 4459 || 1 || 0 || 1
 
|-
 
| 40 || 4686 || 1 || 0 || 1
 
|-
 
| 41 || 4609 || 1 || 0 || 1
 
|-
 
| 42 || 4489 || 1 || 0 || 1
 
|-
 
| 43 || 4465 || 1 || 0 || 1
 
|-
 
| 44 || 4641 || 1 || 0 || 1
 
|-
 
| 45 || 4707 || 1 || 0 || 1
 
|-
 
| 46 || 4539 || 1 || 0 || 1
 
|-
 
| 47 || 4540 || 1 || 0 || 1
 
|-
 
| 48 || 4813 || 3 || 0 || 3 || 412 || 412 || 412.0 || 0.000928 || 0.000405 || 0.0006665
 
|-
 
| 49 || 4425 || 17 || 0 || 17 || 380 || 380 || 380.0 || 0.012858 || 0.000314 || 0.0024941250000000002
 
|-
 
| 50 || 4620 || 11 || 0 || 11 || 396 || 396 || 396.0 || 0.022816 || 0.000463 || 0.006890599999999999
 
|-
 
| 51 || 4525 || 32 || 0 || 32 || 388 || 388 || 388.0 || 0.061139 || 0.000387 || 0.00679132258064516
 
|-
 
| 52 || 4762 || 4 || 0 || 4 || 408 || 408 || 408.0 || 0.046096 || 0.018953 || 0.031662
 
|-
 
| 53 || 4583 || 19 || 0 || 19 || 393 || 393 || 393.0 || 0.018943 || 0.000514 || 0.006347722222222222
 
|-
 
| 54 || 4628 || 14 || 0 || 14 || 397 || 397 || 397.0 || 0.041793 || 0.000596 || 0.012489384615384614
 
|-
 
| 55 || 4521 || 38 || 1 || 37 || 394 || 389 || 393.0 || 0.040649 || 0.000447 || 0.009107486486486486
 
|-
 
| 56 || 4533 || 33 || 0 || 33 || 388 || 388 || 388.0 || 0.029611 || 0.000359 || 0.004132593750000001
 
|-
 
| 57 || 4476 || 46 || 0 || 46 || 384 || 384 || 384.0 || 0.038396 || 0.000364 || 0.006301111111111111
 
|-
 
| 58 || 4603 || 54 || 4 || 50 || 9376 || 395 || 8107.0 || 0.805219 || 0.000388 || 0.08217690566037736
 
|-
 
| 59 || 4798 || 63 || 5 || 58 || 22391 || 411 || 21441.0 || 2.142464 || 0.000345 || 0.19465403225806455
 
|-
 
| 60 || 4490 || 36 || 0 || 36 || 385 || 385 || 385.0 || 0.023103 || 0.000337 || 0.005721457142857143
 
|-
 
| 61 || 4512 || 45 || 0 || 45 || 387 || 387 || 387.0 || 0.038251 || 0.000424 || 0.00701115909090909
 
|-
 
| 62 || 4582 || 60 || 6 || 54 || 9883 || 393 || 8875.0 || 1.112903 || 0.000483 || 0.10731481355932204
 
|-
 
| 63 || 4699 || 67 || 7 || 60 || 21908 || 403 || 21305.0 || 1.537622 || 0.000399 || 0.1713687424242424
 
|-
 
| 64 || 4818 || 1 || 0 || 1
 
|-
 
| 65 || 4816 || 2 || 0 || 2 || 412 || 412 || 412.0 || 0.00045 || 0.00045 || 0.00045
 
|-
 
| 66 || 4626 || 1 || 0 || 1
 
|-
 
| 67 || 4727 || 2 || 0 || 2 || 405 || 405 || 405.0 || 0.000464 || 0.000464 || 0.000464
 
|-
 
| 68 || 4623 || 1 || 0 || 1
 
|-
 
| 69 || 4837 || 2 || 0 || 2 || 414 || 414 || 414.0 || 0.000473 || 0.000473 || 0.000473
 
|-
 
| 70 || 4454 || 1 || 1 || 0
 
|-
 
| 71 || 4429 || 2 || 0 || 2 || 381 || 381 || 381.0 || 0.000438 || 0.000438 || 0.000438
 
|-
 
| 72 || 4896 || 1 || 0 || 1
 
|-
 
| 73 || 5117 || 1 || 0 || 1
 
|-
 
| 74 || 4669 || 1 || 0 || 1
 
|-
 
| 75 || 4841 || 1 || 0 || 1
 
|-
 
| 76 || 4804 || 1 || 0 || 1
 
|-
 
| 77 || 4988 || 1 || 0 || 1
 
|-
 
| 78 || 4587 || 1 || 1 || 0
 
|-
 
| 79 || 4616 || 1 || 0 || 1
 
|-
 
| 80 || 4746 || 15 || 0 || 15 || 407 || 407 || 407.0 || 0.018839 || 0.000579 || 0.010480928571428572
 
|-
 
| 81 || 4600 || 17 || 0 || 17 || 394 || 394 || 394.0 || 0.033308 || 0.000398 || 0.0047910625
 
|-
 
| 82 || 4909 || 22 || 0 || 22 || 627 || 429 || 571.0 || 0.051229 || 0.000809 || 0.014659999999999996
 
|-
 
| 83 || 4768 || 25 || 0 || 25 || 607 || 408 || 570.0 || 0.054998 || 0.000675 || 0.013141125000000002
 
|-
 
| 84 || 4596 || 31 || 0 || 31 || 394 || 394 || 394.0 || 0.018374 || 0.000358 || 0.005900033333333332
 
|-
 
| 85 || 4484 || 33 || 0 || 33 || 385 || 385 || 385.0 || 0.040269 || 0.000366 || 0.00621278125
 
|-
 
| 86 || 4879 || 45 || 4 || 41 || 21582 || 818 || 14618.0 || 0.856606 || 0.000981 || 0.086496
 
|-
 
| 87 || 4722 || 54 || 6 || 48 || 19733 || 413 || 15960.0 || 1.694223 || 0.000403 || 0.22801369811320754
 
|-
 
| 88 || 4637 || 12 || 0 || 12 || 397 || 397 || 397.0 || 0.0184 || 0.000352 || 0.006041727272727273
 
|-
 
| 89 || 4901 || 6 || 0 || 6 || 419 || 419 || 419.0 || 0.024881 || 0.000641 || 0.0060704
 
|-
 
| 90 || 4698 || 19 || 0 || 19 || 527 || 515 || 522.0 || 0.032079 || 0.000546 || 0.012114944444444442
 
|-
 
| 91 || 4873 || 9 || 0 || 9 || 418 || 418 || 418.0 || 0.011423 || 0.000847 || 0.004115875
 
|-
 
| 92 || 4534 || 24 || 0 || 24 || 388 || 388 || 388.0 || 0.021887 || 0.00037 || 0.005878608695652173
 
|-
 
| 93 || 4708 || 11 || 0 || 11 || 403 || 403 || 403.0 || 0.015462 || 0.000409 || 0.0031311999999999998
 
|-
 
| 94 || 4609 || 42 || 5 || 37 || 10745 || 520 || 10079.0 || 0.66151 || 0.001178 || 0.13872612195121953
 
|-
 
| 95 || 4558 || 22 || 0 || 22 || 408 || 391 || 405.0 || 0.031273 || 0.000437 || 0.007883619047619047
 
|-
 
| 96 || 4594 || 1 || 0 || 1
 
|-
 
| 97 || 4676 || 3 || 0 || 3 || 401 || 401 || 401.0 || 0.000473 || 0.000463 || 0.000468
 
|-
 
| 98 || 4465 || 1 || 0 || 1
 
|-
 
| 99 || 4467 || 3 || 0 || 3 || 384 || 384 || 384.0 || 0.00045 || 0.000442 || 0.000446
 
|-
 
| 100 || 4726 || 1 || 0 || 1
 
|-
 
| 101 || 4658 || 2 || 0 || 2 || 399 || 399 || 399.0 || 0.000494 || 0.000494 || 0.000494
 
|-
 
| 102 || 4508 || 1 || 0 || 1
 
|-
 
| 103 || 4525 || 2 || 0 || 2 || 388 || 388 || 388.0 || 0.00049 || 0.00049 || 0.00049
 
|-
 
| 104 || 4718 || 2 || 0 || 2 || 405 || 405 || 405.0 || 0.000476 || 0.000476 || 0.000476
 
|-
 
| 105 || 4967 || 2 || 0 || 2 || 425 || 425 || 425.0 || 0.00051 || 0.00051 || 0.00051
 
|-
 
| 106 || 4481 || 2 || 0 || 2 || 385 || 385 || 385.0 || 0.000452 || 0.000452 || 0.000452
 
|-
 
| 107 || 4571 || 2 || 0 || 2 || 392 || 392 || 392.0 || 0.000471 || 0.000471 || 0.000471
 
|-
 
| 108 || 4786 || 1 || 0 || 1
 
|-
 
| 109 || 4823 || 1 || 0 || 1
 
|-
 
| 110 || 4574 || 1 || 1 || 0
 
|-
 
| 111 || 4680 || 1 || 0 || 1
 
|-
 
| 112 || 4574 || 51 || 0 || 51 || 392 || 392 || 392.0 || 0.047324 || 0.000392 || 0.005151880000000001
 
|-
 
| 113 || 4489 || 52 || 0 || 52 || 385 || 385 || 385.0 || 0.060409 || 0.000312 || 0.005352901960784314
 
|-
 
| 114 || 4736 || 72 || 4 || 68 || 23594 || 414 || 17669.0 || 1.006988 || 0.000343 || 0.08559649295774648
 
|-
 
| 115 || 4735 || 83 || 7 || 76 || 22078 || 406 || 18987.0 || 2.747555 || 0.000391 || 0.22780202439024386
 
|-
 
| 116 || 4481 || 47 || 0 || 47 || 385 || 385 || 385.0 || 0.03056 || 0.000375 || 0.005288021739130433
 
|-
 
| 117 || 4531 || 46 || 0 || 46 || 389 || 389 || 389.0 || 0.043212 || 0.000331 || 0.006133044444444443
 
|-
 
| 118 || 4789 || 69 || 7 || 62 || 20996 || 418 || 17145.0 || 1.757034 || 0.000356 || 0.1959893823529412
 
|-
 
| 119 || 4608 || 81 || 6 || 75 || 21187 || 396 || 18847.0 || 2.456932 || 0.000378 || 0.22400851249999998
 
|-
 
| 120 || 4518 || 36 || 0 || 36 || 387 || 387 || 387.0 || 0.028003 || 0.000351 || 0.004179828571428572
 
|-
 
| 121 || 4695 || 17 || 0 || 17 || 402 || 402 || 402.0 || 0.036991 || 0.000394 || 0.005922875
 
|-
 
| 122 || 4632 || 63 || 5 || 58 || 8865 || 463 || 8604.0 || 0.732422 || 0.000591 || 0.10695459677419356
 
|-
 
| 123 || 4671 || 33 || 0 || 33 || 401 || 400 || 401.0 || 0.026674 || 0.000354 || 0.007890125000000001
 
|-
 
| 124 || 4484 || 33 || 0 || 33 || 385 || 385 || 385.0 || 0.036508 || 0.000326 || 0.006485437499999999
 
|-
 
| 125 || 4649 || 16 || 0 || 16 || 399 || 399 || 399.0 || 0.025154 || 0.00034 || 0.006072800000000001
 
|-
 
| 126 || 4461 || 60 || 5 || 55 || 6350 || 5843 || 6265.0 || 0.527465 || 0.008833 || 0.08390650847457627
 
|-
 
| 127 || 4697 || 34 || 0 || 34 || 403 || 403 || 403.0 || 0.033889 || 0.00043 || 0.006612545454545454
 
|-
 
| 128 || 5001 || 5 || 0 || 5 || 429 || 429 || 429.0 || 0.017186 || 0.000428 || 0.00848025
 
|-
 
| 129 || 4783 || 14 || 0 || 14 || 499 || 491 || 494.0 || 0.071658 || 0.000541 || 0.015102230769230767
 
|-
 
| 130 || 4770 || 5 || 0 || 5 || 408 || 408 || 408.0 || 0.036432 || 0.000566 || 0.012671
 
|-
 
| 131 || 4780 || 12 || 0 || 12 || 467 || 412 || 438.0 || 0.03341 || 0.000402 || 0.012121272727272725
 
|-
 
| 132 || 4577 || 10 || 0 || 10 || 392 || 392 || 392.0 || 0.020947 || 0.000367 || 0.006680222222222223
 
|-
 
| 133 || 4618 || 31 || 3 || 28 || 5218 || 4818 || 4942.0 || 0.351238 || 0.006392 || 0.0750992
 
|-
 
| 134 || 4663 || 10 || 0 || 10 || 399 || 399 || 399.0 || 0.037043 || 0.000432 || 0.009523222222222221
 
|-
 
| 135 || 4555 || 28 || 1 || 27 || 3236 || 470 || 1796.0 || 0.107946 || 0.000541 || 0.023689148148148147
 
|-
 
| 136 || 4842 || 24 || 0 || 24 || 833 || 421 || 538.0 || 0.08271 || 0.000418 || 0.013151782608695652
 
|-
 
| 137 || 4958 || 27 || 0 || 27 || 840 || 433 || 655.0 || 0.063228 || 0.000467 || 0.014496038461538463
 
|-
 
| 138 || 4799 || 22 || 0 || 22 || 813 || 412 || 730.0 || 0.055436 || 0.000558 || 0.007774952380952382
 
|-
 
| 139 || 4911 || 26 || 0 || 26 || 842 || 421 || 739.0 || 0.123103 || 0.000465 || 0.025620559999999997
 
|-
 
| 140 || 4801 || 55 || 1 || 54 || 35078 || 764 || 10374.0 || 2.521878 || 0.000641 || 0.10560070370370372
 
|-
 
| 141 || 4818 || 62 || 2 || 60 || 35230 || 814 || 21732.0 || 1.25825 || 0.00093 || 0.14713504918032783
 
|-
 
| 142 || 4742 || 53 || 4 || 49 || 33400 || 415 || 27391.0 || 1.310808 || 0.000573 || 0.2354048461538462
 
|-
 
| 143 || 4829 || 61 || 4 || 57 || 35186 || 421 || 26418.0 || 3.787715 || 0.000825 || 0.30994716666666655
 
|-
 
| 144 || 4887 || 2 || 0 || 2 || 418 || 418 || 418.0 || 0.014348 || 0.014348 || 0.014348
 
|-
 
| 145 || 4587 || 8 || 0 || 8 || 393 || 393 || 393.0 || 0.040848 || 0.000721 || 0.010354142857142857
 
|-
 
| 146 || 5103 || 1 || 0 || 1
 
|-
 
| 147 || 4833 || 3 || 0 || 3 || 414 || 414 || 414.0 || 0.016732 || 0.000898 || 0.008815
 
|-
 
| 148 || 4692 || 4 || 0 || 4 || 402 || 402 || 402.0 || 0.033889 || 0.000556 || 0.016683
 
|-
 
| 149 || 4557 || 16 || 1 || 15 || 391 || 391 || 391.0 || 0.018683 || 0.000472 || 0.004319266666666668
 
|-
 
| 150 || 4964 || 1 || 0 || 1
 
|-
 
| 151 || 4674 || 6 || 0 || 6 || 400 || 400 || 400.0 || 0.028551 || 0.000983 || 0.013714399999999998
 
|-
 
| 152 || 4799 || 16 || 0 || 16 || 493 || 411 || 482.0 || 0.037937 || 0.000534 || 0.0101036
 
|-
 
| 153 || 4674 || 21 || 0 || 21 || 678 || 661 || 674.0 || 0.09922 || 0.000717 || 0.018367699999999994
 
|-
 
| 154 || 4845 || 7 || 0 || 7 || 415 || 415 || 415.0 || 0.00591 || 0.00042 || 0.002009
 
|-
 
| 155 || 4861 || 11 || 0 || 11 || 417 || 417 || 417.0 || 0.032705 || 0.000533 || 0.0148554
 
|-
 
| 156 || 4616 || 37 || 2 || 35 || 10955 || 396 || 9495.0 || 0.84543 || 0.000558 || 0.14547416666666665
 
|-
 
| 157 || 4896 || 47 || 4 || 43 || 29802 || 814 || 28902.0 || 1.4604 || 0.005043 || 0.23156036956521733
 
|-
 
| 158 || 4867 || 16 || 0 || 16 || 418 || 417 || 418.0 || 0.036092 || 0.000502 || 0.011479066666666666
 
|-
 
| 159 || 4743 || 24 || 0 || 24 || 514 || 415 || 507.0 || 0.052268 || 0.000587 || 0.017611521739130432
 
|-
 
| 160 || 4728 || 20 || 0 || 20 || 406 || 406 || 406.0 || 0.020009 || 0.000408 || 0.008198631578947367
 
|-
 
| 161 || 4539 || 53 || 3 || 50 || 1305 || 410 || 954.0 || 0.092867 || 0.000431 || 0.013970576923076926
 
|-
 
| 162 || 4650 || 22 || 0 || 22 || 398 || 398 || 398.0 || 0.027525 || 0.000387 || 0.00920314285714286
 
|-
 
| 163 || 4462 || 51 || 2 || 49 || 1281 || 384 || 1026.0 || 0.173192 || 0.000357 || 0.012442220000000002
 
|-
 
| 164 || 4741 || 25 || 0 || 25 || 407 || 407 || 407.0 || 0.027902 || 0.000388 || 0.006532625
 
|-
 
| 165 || 4557 || 61 || 3 || 58 || 3903 || 486 || 1465.0 || 0.084045 || 0.000469 || 0.012070450000000003
 
|-
 
| 166 || 4749 || 28 || 0 || 28 || 408 || 408 || 408.0 || 0.036397 || 0.000423 || 0.005662185185185185
 
|-
 
| 167 || 4547 || 62 || 6 || 56 || 5675 || 393 || 4951.0 || 0.556404 || 0.000379 || 0.06199437704918033
 
|-
 
| 168 || 4811 || 90 || 5 || 85 || 33750 || 417 || 18049.0 || 2.345832 || 0.000446 || 0.1369888876404494
 
|-
 
| 169 || 4866 || 97 || 2 || 95 || 35510 || 426 || 18884.0 || 2.747791 || 0.000411 || 0.22452585416666662
 
|-
 
| 170 || 4733 || 89 || 3 || 86 || 34065 || 406 || 28104.0 || 1.726143 || 0.00034 || 0.19082899999999994
 
|-
 
| 171 || 5014 || 95 || 7 || 88 || 35596 || 430 || 23707.0 || 3.052361 || 0.000409 || 0.22742587234042558
 
|-
 
| 172 || 4820 || 96 || 1 || 95 || 34465 || 421 || 7042.0 || 0.218778 || 0.000472 || 0.03614748421052631
 
|-
 
| 173 || 4922 || 101 || 2 || 99 || 35520 || 430 || 19368.0 || 3.092187 || 0.000365 || 0.15891331
 
|-
 
| 174 || 4901 || 96 || 5 || 91 || 35540 || 420 || 26870.0 || 4.254684 || 0.000395 || 0.25204304210526324
 
|-
 
| 175 || 5132 || 101 || 4 || 97 || 35517 || 439 || 27090.0 || 2.22364 || 0.000619 || 0.18806341
 
|-
 
| 176 || 4672 || 13 || 0 || 13 || 400 || 400 || 400.0 || 0.029952 || 0.000399 || 0.009411
 
|-
 
| 177 || 4585 || 35 || 0 || 35 || 394 || 393 || 394.0 || 0.032544 || 0.00043 || 0.0068634117647058835
 
|-
 
| 178 || 4895 || 4 || 0 || 4 || 419 || 419 || 419.0 || 0.020005 || 0.000999 || 0.009127999999999999
 
|-
 
| 179 || 4585 || 14 || 0 || 14 || 393 || 393 || 393.0 || 0.036209 || 0.000378 || 0.00787546153846154
 
|-
 
| 180 || 4775 || 17 || 0 || 17 || 410 || 410 || 410.0 || 0.028318 || 0.000435 || 0.00724625
 
|-
 
| 181 || 4460 || 42 || 3 || 39 || 555 || 387 || 538.0 || 0.052798 || 0.000598 || 0.012619195121951218
 
|-
 
| 182 || 4883 || 6 || 0 || 6 || 418 || 418 || 418.0 || 0.032337 || 0.00095 || 0.010706400000000001
 
|-
 
| 183 || 4655 || 19 || 0 || 19 || 398 || 398 || 398.0 || 0.029974 || 0.000575 || 0.009053555555555558
 
|-
 
| 184 || 4798 || 67 || 3 || 64 || 20596 || 411 || 18456.0 || 1.975423 || 0.000372 || 0.24117915151515149
 
|-
 
| 185 || 4741 || 77 || 6 || 71 || 35275 || 803 || 34594.0 || 2.824109 || 0.001208 || 0.24719185526315796
 
|-
 
| 186 || 4787 || 31 || 0 || 31 || 517 || 410 || 493.0 || 0.039667 || 0.000379 || 0.0081323
 
|-
 
| 187 || 4709 || 43 || 0 || 43 || 817 || 412 || 803.0 || 0.075649 || 0.000401 || 0.019051404761904762
 
|-
 
| 188 || 4792 || 71 || 5 || 66 || 25521 || 804 || 23645.0 || 1.902453 || 0.001311 || 0.2771063428571429
 
|-
 
| 189 || 4848 || 78 || 7 || 71 || 35180 || 33582 || 34843.0 || 1.660215 || 0.052097 || 0.22248788311688308
 
|-
 
| 190 || 4672 || 35 || 0 || 35 || 539 || 410 || 519.0 || 0.048332 || 0.000468 || 0.014152470588235292
 
|-
 
| 191 || 4668 || 44 || 0 || 44 || 813 || 787 || 805.0 || 0.079299 || 0.00091 || 0.01713302325581395
 
|-
 
| 192 || 4925 || 32 || 0 || 32 || 842 || 815 || 827.0 || 0.066662 || 0.001037 || 0.017131677419354837
 
|-
 
| 193 || 4824 || 35 || 0 || 35 || 838 || 422 || 565.0 || 0.070966 || 0.000469 || 0.012869823529411765
 
|-
 
| 194 || 4929 || 33 || 0 || 33 || 838 || 431 || 545.0 || 0.0761 || 0.000461 || 0.010275656250000003
 
|-
 
| 195 || 5073 || 37 || 0 || 37 || 857 || 435 || 680.0 || 0.080225 || 0.000457 || 0.013417944444444446
 
|-
 
| 196 || 5103 || 68 || 2 || 66 || 35249 || 33674 || 34415.0 || 2.730947 || 0.049441 || 0.22863904477611938
 
|-
 
| 197 || 4888 || 77 || 4 || 73 || 35319 || 816 || 14284.0 || 1.240214 || 0.001182 || 0.10229803947368421
 
|-
 
| 198 || 4840 || 71 || 2 || 69 || 35261 || 808 || 11567.0 || 1.443657 || 0.000858 || 0.09159465714285712
 
|-
 
| 199 || 4888 || 80 || 4 || 76 || 35230 || 428 || 18831.0 || 2.501586 || 0.00039 || 0.20689413924050631
 
|-
 
| 200 || 4728 || 27 || 0 || 27 || 809 || 414 || 671.0 || 0.034728 || 0.000428 || 0.008012884615384614
 
|-
 
| 201 || 5041 || 13 || 0 || 13 || 441 || 432 || 437.0 || 0.034372 || 0.000528 || 0.007971250000000001
 
|-
 
| 202 || 4847 || 28 || 0 || 28 || 808 || 420 || 748.0 || 0.065262 || 0.000702 || 0.014953111111111108
 
|-
 
| 203 || 4908 || 14 || 0 || 14 || 427 || 421 || 425.0 || 0.021254 || 0.000447 || 0.004600615384615384
 
|-
 
| 204 || 4647 || 60 || 4 || 56 || 34849 || 404 || 19815.0 || 1.498058 || 0.000727 || 0.1357884576271186
 
|-
 
| 205 || 4766 || 33 || 0 || 33 || 802 || 408 || 598.0 || 0.057507 || 0.000471 || 0.008826031249999998
 
|-
 
| 206 || 4697 || 62 || 4 || 58 || 32343 || 640 || 22419.0 || 1.908858 || 0.000594 || 0.2163177540983606
 
|-
 
| 207 || 4657 || 34 || 0 || 34 || 660 || 399 || 549.0 || 0.045163 || 0.00034 || 0.008172454545454544
 
|-
 
| 208 || 4784 || 25 || 0 || 25 || 665 || 414 || 559.0 || 0.098567 || 0.000493 || 0.010815208333333333
 
|-
 
| 209 || 4789 || 27 || 0 || 27 || 652 || 415 || 587.0 || 0.04927 || 0.000755 || 0.008286576923076924
 
|-
 
| 210 || 4903 || 15 || 0 || 15 || 420 || 420 || 420.0 || 0.033982 || 0.000423 || 0.008029357142857144
 
|-
 
| 211 || 4868 || 17 || 0 || 17 || 418 || 418 || 418.0 || 0.02337 || 0.000375 || 0.0108668125
 
|-
 
| 212 || 4946 || 56 || 5 || 51 || 29192 || 432 || 13847.0 || 1.780761 || 0.00083 || 0.21104609090909096
 
|-
 
| 213 || 4782 || 57 || 6 || 51 || 25840 || 613 || 15069.0 || 1.086749 || 0.000654 || 0.1849354285714286
 
|-
 
| 214 || 4662 || 33 || 0 || 33 || 496 || 400 || 435.0 || 0.068018 || 0.000394 || 0.013121562499999998
 
|-
 
| 215 || 4705 || 34 || 0 || 34 || 424 || 404 || 415.0 || 0.034822 || 0.000379 || 0.009416333333333332
 
|-
 
| 216 || 4791 || 20 || 0 || 20 || 470 || 463 || 468.0 || 0.032153 || 0.000722 || 0.008768894736842102
 
|-
 
| 217 || 4913 || 10 || 0 || 10 || 421 || 421 || 421.0 || 0.032853 || 0.000919 || 0.008131888888888888
 
|-
 
| 218 || 4898 || 12 || 0 || 12 || 420 || 420 || 420.0 || 0.017379 || 0.000882 || 0.00776381818181818
 
|-
 
| 219 || 5131 || 6 || 0 || 6 || 439 || 439 || 439.0 || 0.039579 || 0.000904 || 0.016645600000000003
 
|-
 
| 220 || 4633 || 43 || 6 || 37 || 6194 || 5740 || 6012.0 || 0.663521 || 0.00775 || 0.09799988095238095
 
|-
 
| 221 || 4604 || 22 || 0 || 22 || 395 || 395 || 395.0 || 0.031822 || 0.000335 || 0.007726523809523809
 
|-
 
| 222 || 4693 || 25 || 0 || 25 || 402 || 402 || 402.0 || 0.042673 || 0.000347 || 0.011762958333333335
 
|-
 
| 223 || 4852 || 11 || 0 || 11 || 416 || 416 || 416.0 || 0.032192 || 0.000376 || 0.0140429
 
|-
 
| 224 || 5129 || 105 || 2 || 103 || 35629 || 834 || 10904.0 || 1.313984 || 0.000826 || 0.07052285576923077
 
|-
 
| 225 || 4807 || 118 || 3 || 115 || 35596 || 421 || 13050.0 || 1.741935 || 0.000428 || 0.08700684615384614
 
|-
 
| 226 || 5067 || 109 || 3 || 106 || 35571 || 442 || 10643.0 || 1.891894 || 0.000451 || 0.07780433333333334
 
|-
 
| 227 || 5074 || 122 || 3 || 119 || 35594 || 434 || 13368.0 || 1.853441 || 0.00046 || 0.12165690909090908
 
|-
 
| 228 || 5124 || 102 || 1 || 101 || 35642 || 830 || 4125.0 || 1.295953 || 0.000978 || 0.035116
 
|-
 
| 229 || 4867 || 118 || 4 || 114 || 35667 || 425 || 10893.0 || 2.992325 || 0.000421 || 0.15099828205128202
 
|-
 
| 230 || 5084 || 106 || 2 || 104 || 35719 || 443 || 5771.0 || 1.426547 || 0.000462 || 0.036069704761904756
 
|-
 
| 231 || 5047 || 123 || 4 || 119 || 35571 || 433 || 17022.0 || 1.856241 || 0.000405 || 0.17661686885245903
 
|-
 
| 232 || 4688 || 91 || 8 || 83 || 30024 || 407 || 19189.0 || 1.538931 || 0.00042 || 0.16070555555555555
 
|-
 
| 233 || 4685 || 50 || 0 || 50 || 466 || 402 || 438.0 || 0.033421 || 0.000364 || 0.004877795918367347
 
|-
 
| 234 || 4849 || 94 || 7 || 87 || 27433 || 420 || 21737.0 || 2.013652 || 0.000462 || 0.21656583870967744
 
|-
 
| 235 || 4749 || 51 || 0 || 51 || 431 || 407 || 424.0 || 0.038251 || 0.000408 || 0.007048679999999999
 
|-
 
| 236 || 4734 || 88 || 6 || 82 || 26492 || 636 || 19175.0 || 2.213252 || 0.000884 || 0.20057063218390805
 
|-
 
| 237 || 4618 || 51 || 0 || 51 || 399 || 396 || 397.0 || 0.039464 || 0.000356 || 0.006376559999999999
 
|-
 
| 238 || 4849 || 90 || 6 || 84 || 26933 || 420 || 25067.0 || 2.684458 || 0.000411 || 0.2438207528089887
 
|-
 
| 239 || 4611 || 51 || 0 || 51 || 398 || 396 || 398.0 || 0.034461 || 0.000375 || 0.009286019999999999
 
|-
 
| 240 || 4792 || 87 || 4 || 83 || 35199 || 418 || 27784.0 || 2.947441 || 0.000439 || 0.24737167441860455
 
|-
 
| 241 || 4888 || 88 || 8 || 80 || 34145 || 422 || 29209.0 || 3.038667 || 0.000449 || 0.28930131034482776
 
|-
 
| 242 || 4888 || 54 || 0 || 54 || 834 || 419 || 696.0 || 0.060277 || 0.000397 || 0.013741905660377356
 
|-
 
| 243 || 4770 || 53 || 0 || 53 || 732 || 409 || 662.0 || 0.057123 || 0.000396 || 0.008603365384615385
 
|-
 
| 244 || 4858 || 83 || 7 || 76 || 35283 || 808 || 31108.0 || 2.79696 || 0.001199 || 0.29113229268292684
 
|-
 
| 245 || 4740 || 86 || 7 || 79 || 34881 || 414 || 31750.0 || 2.356987 || 0.00043 || 0.28524752941176473
 
|-
 
| 246 || 4802 || 50 || 0 || 50 || 833 || 420 || 753.0 || 0.078215 || 0.000421 || 0.016389816326530613
 
|-
 
| 247 || 4793 || 49 || 0 || 49 || 794 || 410 || 743.0 || 0.073413 || 0.000413 || 0.012781625000000003
 
|-
 
| 248 || 4579 || 65 || 5 || 60 || 8885 || 470 || 8654.0 || 0.668934 || 0.000592 || 0.1190871875
 
|-
 
| 249 || 4770 || 33 || 0 || 33 || 409 || 409 || 409.0 || 0.03466 || 0.000364 || 0.00937528125
 
|-
 
| 250 || 4775 || 37 || 0 || 37 || 410 || 410 || 410.0 || 0.040477 || 0.000378 || 0.007337555555555554
 
|-
 
| 251 || 4974 || 16 || 0 || 16 || 426 || 426 || 426.0 || 0.042725 || 0.000416 || 0.010310999999999999
 
|-
 
| 252 || 4625 || 62 || 5 || 57 || 11588 || 505 || 11335.0 || 0.897079 || 0.000747 || 0.14752404918032785
 
|-
 
| 253 || 4691 || 32 || 0 || 32 || 402 || 402 || 402.0 || 0.037126 || 0.000361 || 0.010469322580645162
 
|-
 
| 254 || 4617 || 34 || 0 || 34 || 400 || 396 || 399.0 || 0.026872 || 0.000357 || 0.008994151515151514
 
|-
 
| 255 || 4872 || 15 || 0 || 15 || 417 || 417 || 417.0 || 0.048537 || 0.000463 || 0.014429857142857145
 
|-
 
| 256 || 5234 || 1 || 0 || 1
 
|-
 
| 257 || 4651 || 1 || 0 || 1
 
|-
 
| 258 || 4671 || 1 || 0 || 1
 
|-
 
| 259 || 4538 || 1 || 1 || 0
 
|-
 
| 260 || 4869 || 2 || 0 || 2 || 418 || 418 || 418.0 || 0.000393 || 0.000393 || 0.000393
 
|-
 
| 261 || 4671 || 2 || 0 || 2 || 400 || 400 || 400.0 || 0.000377 || 0.000377 || 0.000377
 
|-
 
| 262 || 4724 || 2 || 0 || 2 || 405 || 405 || 405.0 || 0.000385 || 0.000385 || 0.000385
 
|-
 
| 263 || 4521 || 2 || 0 || 2 || 388 || 388 || 388.0 || 0.000367 || 0.000367 || 0.000367
 
|-
 
| 264 || 4664 || 1 || 0 || 1
 
|-
 
| 265 || 4673 || 1 || 0 || 1
 
|-
 
| 266 || 4515 || 1 || 0 || 1
 
|-
 
| 267 || 4513 || 1 || 0 || 1
 
|-
 
| 268 || 4666 || 2 || 0 || 2 || 400 || 400 || 400.0 || 0.000386 || 0.000386 || 0.000386
 
|-
 
| 269 || 4558 || 2 || 0 || 2 || 391 || 391 || 391.0 || 0.000835 || 0.000835 || 0.000835
 
|-
 
| 270 || 4510 || 2 || 0 || 2 || 386 || 386 || 386.0 || 0.000364 || 0.000364 || 0.000364
 
|-
 
| 271 || 4569 || 2 || 0 || 2 || 392 || 392 || 392.0 || 0.000979 || 0.000979 || 0.000979
 
|-
 
| 272 || 4784 || 9 || 0 || 9 || 410 || 410 || 410.0 || 0.031732 || 0.000407 || 0.0154075
 
|-
 
| 273 || 4564 || 26 || 0 || 26 || 391 || 391 || 391.0 || 0.029549 || 0.000406 || 0.0072178
 
|-
 
| 274 || 4513 || 18 || 0 || 18 || 387 || 387 || 387.0 || 0.022865 || 0.0005 || 0.007096
 
|-
 
| 275 || 4623 || 43 || 2 || 41 || 1022 || 475 || 887.0 || 0.095425 || 0.000505 || 0.0129385
 
|-
 
| 276 || 4625 || 13 || 0 || 13 || 396 || 396 || 396.0 || 0.01638 || 0.000374 || 0.0026061666666666664
 
|-
 
| 277 || 4448 || 30 || 0 || 30 || 381 || 381 || 381.0 || 0.022676 || 0.000334 || 0.007312275862068967
 
|-
 
| 278 || 4669 || 22 || 0 || 22 || 400 || 400 || 400.0 || 0.031952 || 0.000445 || 0.007112190476190477
 
|-
 
| 279 || 4555 || 51 || 5 || 46 || 2084 || 392 || 1823.0 || 0.18679 || 0.000434 || 0.02254728
 
|-
 
| 280 || 4579 || 44 || 0 || 44 || 393 || 393 || 393.0 || 0.030298 || 0.000337 || 0.007696604651162791
 
|-
 
| 281 || 4548 || 49 || 0 || 49 || 390 || 390 || 390.0 || 0.038349 || 0.000415 || 0.007028229166666667
 
|-
 
| 282 || 4609 || 68 || 5 || 63 || 15042 || 401 || 10994.0 || 1.12152 || 0.000535 || 0.11490973134328362
 
|-
 
| 283 || 4522 || 71 || 5 || 66 || 22051 || 395 || 14898.0 || 1.732319 || 0.00041 || 0.18782437142857147
 
|-
 
| 284 || 4517 || 47 || 0 || 47 || 387 || 387 || 387.0 || 0.026073 || 0.000347 || 0.006048499999999999
 
|-
 
| 285 || 4468 || 49 || 0 || 49 || 383 || 383 || 383.0 || 0.051758 || 0.000349 || 0.00749775
 
|-
 
| 286 || 4629 || 78 || 6 || 72 || 17070 || 396 || 13240.0 || 1.05898 || 0.000353 || 0.1782791558441558
 
|-
 
| 287 || 4560 || 83 || 6 || 77 || 24214 || 391 || 19350.0 || 1.801677 || 0.000539 || 0.15831074390243902
 
|-
 
| 288 || 4873 || 1 || 0 || 1
 
|-
 
| 289 || 4669 || 1 || 0 || 1
 
|-
 
| 290 || 4675 || 1 || 0 || 1
 
|-
 
| 291 || 4513 || 1 || 1 || 0
 
|-
 
| 292 || 4929 || 1 || 0 || 1
 
|-
 
| 293 || 5066 || 1 || 0 || 1
 
|-
 
| 294 || 4898 || 1 || 0 || 1
 
|-
 
| 295 || 4664 || 1 || 0 || 1
 
|-
 
| 296 || 4691 || 1 || 0 || 1
 
|-
 
| 297 || 4692 || 1 || 0 || 1
 
|-
 
| 298 || 4497 || 1 || 0 || 1
 
|-
 
| 299 || 4513 || 1 || 0 || 1
 
|-
 
| 300 || 5283 || 1 || 0 || 1
 
|-
 
| 301 || 4870 || 1 || 0 || 1
 
|-
 
| 302 || 4666 || 1 || 0 || 1
 
|-
 
| 303 || 4626 || 1 || 0 || 1
 
|-
 
| 304 || 4698 || 10 || 0 || 10 || 403 || 403 || 403.0 || 0.022218 || 0.000496 || 0.007235666666666666
 
|-
 
| 305 || 4364 || 22 || 0 || 22 || 374 || 374 || 374.0 || 0.025065 || 0.000348 || 0.008061333333333334
 
|-
 
| 306 || 4743 || 15 || 0 || 15 || 407 || 407 || 407.0 || 0.042199 || 0.000556 || 0.010222642857142857
 
|-
 
| 307 || 4534 || 36 || 4 || 32 || 3796 || 3500 || 3751.0 || 0.339467 || 0.004786 || 0.04757462857142857
 
|-
 
| 308 || 4876 || 5 || 0 || 5 || 418 || 418 || 418.0 || 0.001252 || 0.000553 || 0.00085425
 
|-
 
| 309 || 4606 || 11 || 0 || 11 || 394 || 394 || 394.0 || 0.027692 || 0.000346 || 0.004638000000000001
 
|-
 
| 310 || 4846 || 8 || 0 || 8 || 415 || 415 || 415.0 || 0.032326 || 0.00048 || 0.006603
 
|-
 
| 311 || 4659 || 19 || 0 || 19 || 446 || 441 || 445.0 || 0.031849 || 0.000426 || 0.006205500000000001
 
|-
 
| 312 || 4480 || 34 || 0 || 34 || 385 || 385 || 385.0 || 0.039385 || 0.000337 || 0.008765848484848484
 
|-
 
| 313 || 4500 || 37 || 0 || 37 || 386 || 386 || 386.0 || 0.031724 || 0.000372 || 0.007139055555555557
 
|-
 
| 314 || 4620 || 57 || 6 || 51 || 17655 || 516 || 16870.0 || 1.384116 || 0.000595 || 0.2914791428571429
 
|-
 
| 315 || 4704 || 62 || 6 || 56 || 24510 || 23497 || 24332.0 || 3.002376 || 0.033815 || 0.30594893442622956
 
|-
 
| 316 || 4647 || 17 || 0 || 17 || 398 || 398 || 398.0 || 0.02186 || 0.000347 || 0.0048635625
 
|-
 
| 317 || 4652 || 20 || 0 || 20 || 399 || 399 || 399.0 || 0.024712 || 0.000374 || 0.005520368421052632
 
|-
 
| 318 || 4784 || 30 || 0 || 30 || 621 || 412 || 603.0 || 0.049087 || 0.000383 || 0.009207137931034483
 
|-
 
| 319 || 4775 || 36 || 0 || 36 || 702 || 689 || 699.0 || 0.073271 || 0.000809 || 0.02001354285714286
 
|-
 
| 320 || 4667 || 1 || 0 || 1
 
|-
 
| 321 || 4609 || 2 || 0 || 2 || 395 || 395 || 395.0 || 0.000479 || 0.000479 || 0.000479
 
|-
 
| 322 || 4479 || 1 || 1 || 0
 
|-
 
| 323 || 4526 || 2 || 0 || 2 || 388 || 388 || 388.0 || 0.00048 || 0.00048 || 0.00048
 
|-
 
| 324 || 4683 || 2 || 0 || 2 || 402 || 402 || 402.0 || 0.000982 || 0.000982 || 0.000982
 
|-
 
| 325 || 4626 || 3 || 0 || 3 || 397 || 397 || 397.0 || 0.000728 || 0.000455 || 0.0005915
 
|-
 
| 326 || 4427 || 2 || 0 || 2 || 380 || 380 || 380.0 || 0.005516 || 0.005516 || 0.005516
 
|-
 
| 327 || 4560 || 3 || 0 || 3 || 391 || 391 || 391.0 || 0.000854 || 0.000505 || 0.0006795
 
|-
 
| 328 || 4695 || 1 || 0 || 1
 
|-
 
| 329 || 4812 || 1 || 0 || 1
 
|-
 
| 330 || 4414 || 1 || 0 || 1
 
|-
 
| 331 || 4847 || 1 || 0 || 1
 
|-
 
| 332 || 4680 || 1 || 0 || 1
 
|-
 
| 333 || 5107 || 1 || 0 || 1
 
|-
 
| 334 || 4459 || 1 || 0 || 1
 
|-
 
| 335 || 4684 || 1 || 0 || 1
 
|-
 
| 336 || 4476 || 47 || 0 || 47 || 384 || 384 || 384.0 || 0.050207 || 0.000405 || 0.006834717391304347
 
|-
 
| 337 || 4530 || 45 || 0 || 45 || 389 || 389 || 389.0 || 0.039705 || 0.000359 || 0.006810113636363635
 
|-
 
| 338 || 4679 || 73 || 1 || 72 || 20668 || 790 || 13127.0 || 0.885686 || 0.000988 || 0.1188362361111111
 
|-
 
| 339 || 4551 || 80 || 4 || 76 || 22115 || 398 || 15998.0 || 1.533126 || 0.000373 || 0.18685337974683539
 
|-
 
| 340 || 4438 || 46 || 0 || 46 || 381 || 381 || 381.0 || 0.034865 || 0.000346 || 0.005006955555555557
 
|-
 
| 341 || 4535 || 45 || 0 || 45 || 389 || 389 || 389.0 || 0.045882 || 0.000314 || 0.005172159090909092
 
|-
 
| 342 || 4583 || 83 || 5 || 78 || 25585 || 401 || 16405.0 || 2.383814 || 0.000477 || 0.17421218292682927
 
|-
 
| 343 || 4616 || 88 || 5 || 83 || 23634 || 396 || 20156.0 || 1.244632 || 0.000397 || 0.13510183908045975
 
|-
 
| 344 || 4405 || 31 || 0 || 31 || 378 || 378 || 378.0 || 0.019572 || 0.00033 || 0.005825899999999999
 
|-
 
| 345 || 4587 || 16 || 0 || 16 || 394 || 394 || 394.0 || 0.037612 || 0.000338 || 0.006420733333333334
 
|-
 
| 346 || 4625 || 59 || 5 || 54 || 11188 || 492 || 10465.0 || 0.971001 || 0.00074 || 0.15938786206896552
 
|-
 
| 347 || 4681 || 32 || 0 || 32 || 404 || 402 || 403.0 || 0.044012 || 0.000363 || 0.008428870967741937
 
|-
 
| 348 || 4516 || 30 || 0 || 30 || 387 || 387 || 387.0 || 0.018138 || 0.000428 || 0.005765896551724139
 
|-
 
| 349 || 4644 || 16 || 0 || 16 || 398 || 398 || 398.0 || 0.028985 || 0.000383 || 0.0034938666666666667
 
|-
 
| 350 || 4576 || 61 || 5 || 56 || 14406 || 564 || 14023.0 || 0.8327 || 0.000917 || 0.1307434
 
|-
 
| 351 || 4634 || 32 || 0 || 32 || 445 || 400 || 442.0 || 0.030715 || 0.000381 || 0.010195903225806451
 
|-
 
| 352 || 4695 || 1 || 0 || 1
 
|-
 
| 353 || 4604 || 2 || 0 || 2 || 394 || 394 || 394.0 || 0.000634 || 0.000634 || 0.000634
 
|-
 
| 354 || 4535 || 1 || 1 || 0
 
|-
 
| 355 || 4542 || 2 || 0 || 2 || 390 || 390 || 390.0 || 0.000964 || 0.000964 || 0.000964
 
|-
 
| 356 || 4827 || 1 || 0 || 1
 
|-
 
| 357 || 4861 || 2 || 0 || 2 || 417 || 417 || 417.0 || 0.00103 || 0.00103 || 0.00103
 
|-
 
| 358 || 4647 || 1 || 0 || 1
 
|-
 
| 359 || 4644 || 2 || 0 || 2 || 398 || 398 || 398.0 || 0.001944 || 0.001944 || 0.001944
 
|-
 
| 360 || 4732 || 1 || 0 || 1
 
|-
 
| 361 || 4910 || 1 || 0 || 1
 
|-
 
| 362 || 4470 || 1 || 1 || 0
 
|-
 
| 363 || 4737 || 1 || 0 || 1
 
|-
 
| 364 || 4920 || 1 || 0 || 1
 
|-
 
| 365 || 5125 || 1 || 0 || 1
 
|-
 
| 366 || 4627 || 1 || 0 || 1
 
|-
 
| 367 || 4884 || 1 || 0 || 1
 
|-
 
| 368 || 4597 || 35 || 0 || 35 || 394 || 394 || 394.0 || 0.022988 || 0.000372 || 0.007171117647058824
 
|-
 
| 369 || 4465 || 34 || 0 || 34 || 383 || 383 || 383.0 || 0.018807 || 0.000364 || 0.005009666666666667
 
|-
 
| 370 || 4697 || 64 || 7 || 57 || 26323 || 698 || 24090.0 || 1.030364 || 0.001276 || 0.1931083333333333
 
|-
 
| 371 || 4641 || 65 || 5 || 60 || 23805 || 642 || 22240.0 || 1.984989 || 0.000734 || 0.21763387499999998
 
|-
 
| 372 || 4664 || 19 || 0 || 19 || 400 || 400 || 400.0 || 0.055555 || 0.000399 || 0.005936333333333333
 
|-
 
| 373 || 4694 || 19 || 0 || 19 || 402 || 402 || 402.0 || 0.026396 || 0.00044 || 0.005943944444444444
 
|-
 
| 374 || 4787 || 37 || 0 || 37 || 726 || 416 || 680.0 || 0.056771 || 0.000655 || 0.012783333333333336
 
|-
 
| 375 || 4809 || 37 || 0 || 37 || 697 || 418 || 678.0 || 0.061221 || 0.000786 || 0.010880361111111111
 
|-
 
| 376 || 4483 || 21 || 0 || 21 || 385 || 385 || 385.0 || 0.021498 || 0.000383 || 0.007484349999999999
 
|-
 
| 377 || 4677 || 11 || 0 || 11 || 401 || 401 || 401.0 || 0.014198 || 0.000361 || 0.0026276
 
|-
 
| 378 || 4587 || 45 || 5 || 40 || 15751 || 15109 || 15656.0 || 1.321379 || 0.022048 || 0.22873999999999992
 
|-
 
| 379 || 4732 || 22 || 0 || 22 || 504 || 496 || 502.0 || 0.05338 || 0.000536 || 0.01617090476190476
 
|-
 
| 380 || 4727 || 11 || 0 || 11 || 405 || 405 || 405.0 || 0.008131 || 0.000495 || 0.0025351
 
|-
 
| 381 || 4908 || 6 || 0 || 6 || 420 || 420 || 420.0 || 0.017446 || 0.000564 || 0.0041475999999999996
 
|-
 
| 382 || 4730 || 23 || 0 || 23 || 594 || 585 || 592.0 || 0.070342 || 0.00065 || 0.013495272727272724
 
|-
 
| 383 || 4843 || 11 || 0 || 11 || 417 || 417 || 417.0 || 0.029881 || 0.000694 || 0.009650099999999998
 
|-
 
| 384 || 4768 || 30 || 0 || 30 || 408 || 408 || 408.0 || 0.033587 || 0.000436 || 0.008093793103448276
 
|-
 
| 385 || 4622 || 68 || 5 || 63 || 12362 || 11678 || 11955.0 || 1.077353 || 0.015741 || 0.15566234328358206
 
|-
 
| 386 || 4874 || 31 || 0 || 31 || 419 || 419 || 419.0 || 0.040599 || 0.000441 || 0.009222733333333335
 
|-
 
| 387 || 4584 || 67 || 3 || 64 || 9041 || 540 || 5292.0 || 0.971151 || 0.000695 || 0.08751284848484848
 
|-
 
| 388 || 4603 || 31 || 0 || 31 || 394 || 394 || 394.0 || 0.018894 || 0.000413 || 0.005867733333333333
 
|-
 
| 389 || 4566 || 72 || 2 || 70 || 13225 || 526 || 6177.0 || 1.109463 || 0.000478 || 0.08201674647887325
 
|-
 
| 390 || 4598 || 27 || 0 || 27 || 394 || 394 || 394.0 || 0.022414 || 0.000396 || 0.005126923076923076
 
|-
 
| 391 || 4591 || 66 || 3 || 63 || 4665 || 396 || 2706.0 || 0.450731 || 0.000324 || 0.051266800000000015
 
|-
 
| 392 || 4474 || 104 || 3 || 101 || 35626 || 770 || 11495.0 || 3.062043 || 0.000846 || 0.1439266796116505
 
|-
 
| 393 || 4738 || 105 || 1 || 104 || 35668 || 803 || 6554.0 || 2.010033 || 0.000893 || 0.07351879807692309
 
|-
 
| 394 || 4839 || 101 || 4 || 97 || 35569 || 421 || 15567.0 || 2.387245 || 0.000436 || 0.17715432999999997
 
|-
 
| 395 || 4866 || 104 || 2 || 102 || 35649 || 424 || 8060.0 || 1.379257 || 0.000412 || 0.06237811650485437
 
|-
 
| 396 || 4639 || 112 || 4 || 108 || 35643 || 407 || 12872.0 || 1.777006 || 0.000386 || 0.11943261261261262
 
|-
 
| 397 || 4878 || 120 || 4 || 116 || 35628 || 427 || 11879.0 || 1.943148 || 0.00039 || 0.1040158487394958
 
|-
 
| 398 || 4754 || 104 || 4 || 100 || 34782 || 408 || 20463.0 || 2.427207 || 0.000376 || 0.20670459223300966
 
|-
 
| 399 || 4939 || 117 || 5 || 112 || 35556 || 423 || 21489.0 || 2.864864 || 0.000462 || 0.22705166379310343
 
|-
 
| 400 || 4586 || 21 || 0 || 21 || 394 || 394 || 394.0 || 0.047973 || 0.00046 || 0.010071199999999999
 
|-
 
| 401 || 4490 || 49 || 3 || 46 || 676 || 576 || 642.0 || 0.101147 || 0.000792 || 0.015656104166666667
 
|-
 
| 402 || 4958 || 9 || 0 || 9 || 425 || 425 || 425.0 || 0.040535 || 0.000399 || 0.01302675
 
|-
 
| 403 || 4625 || 24 || 0 || 24 || 396 || 396 || 396.0 || 0.029705 || 0.000375 || 0.0073292608695652165
 
|-
 
| 404 || 4603 || 16 || 0 || 16 || 395 || 395 || 395.0 || 0.040206 || 0.000358 || 0.012326733333333333
 
|-
 
| 405 || 4562 || 43 || 3 || 40 || 397 || 391 || 395.0 || 0.079189 || 0.000322 || 0.009798333333333334
 
|-
 
| 406 || 4810 || 7 || 0 || 7 || 412 || 412 || 412.0 || 0.032593 || 0.000369 || 0.010081833333333333
 
|-
 
| 407 || 4682 || 22 || 0 || 22 || 402 || 402 || 402.0 || 0.078205 || 0.000331 || 0.01077247619047619
 
|-
 
| 408 || 4663 || 76 || 5 || 71 || 24699 || 407 || 20216.0 || 2.342201 || 0.00051 || 0.27327171999999983
 
|-
 
| 409 || 4714 || 81 || 3 || 78 || 35366 || 799 || 16662.0 || 2.013789 || 0.00095 || 0.1843358625
 
|-
 
| 410 || 4717 || 40 || 0 || 40 || 480 || 405 || 453.0 || 0.046294 || 0.000392 || 0.012555666666666666
 
|-
 
| 411 || 4781 || 47 || 0 || 47 || 827 || 419 || 544.0 || 0.062231 || 0.00048 || 0.011631804347826086
 
|-
 
| 412 || 4680 || 71 || 5 || 66 || 16395 || 401 || 14611.0 || 1.435987 || 0.000375 || 0.25640355714285706
 
|-
 
| 413 || 4808 || 81 || 6 || 75 || 33768 || 753 || 26507.0 || 2.607196 || 0.000963 || 0.2028044125
 
|-
 
| 414 || 4701 || 37 || 0 || 37 || 410 || 403 || 408.0 || 0.044317 || 0.000376 || 0.007218472222222221
 
|-
 
| 415 || 4776 || 44 || 0 || 44 || 691 || 411 || 582.0 || 0.093714 || 0.000391 || 0.01211246511627907
 
|-
 
| 416 || 4537 || 21 || 0 || 21 || 389 || 389 || 389.0 || 0.059459 || 0.000367 || 0.006652749999999999
 
 
|-
 
|-
| 417 || 4589 || 50 || 4 || 46 || 18833 || 583 || 15336.0 || 1.570065 || 0.000702 || 0.19838595918367344
+
!      !! colspan=2 | MPI                      !! colspan=2 | PREMA
 
|-
 
|-
| 418 || 4707 || 16 || 0 || 16 || 404 || 404 || 404.0 || 0.02651 || 0.00088 || 0.007709066666666667
+
! Cores !! Total Time (s) !! Number of Elements !! Total Time (s) !! Number of Elements
 
|-
 
|-
| 419 || 4560 || 43 || 3 || 40 || 6224 || 391 || 5333.0 || 0.46456 || 0.000331 || 0.0632607619047619
+
| 100 || 1151.472406|| 49352359 || 208.746450 || 49347855
 
|-
 
|-
| 420 || 4907 || 11 || 0 || 11 || 420 || 420 || 420.0 || 0.045555 || 0.000518 || 0.0084925
+
| 200 || 763.70671 || 49357898 || 121.326012 || 49353442
 
|-
 
|-
| 421 || 4756 || 26 || 0 || 26 || 655 || 412 || 585.0 || 0.059082 || 0.000385 || 0.010911120000000002
+
| 300 || 537.678638 || 49357092 || 105.812248 || 49351224
 
|-
 
|-
| 422 || 4997 || 8 || 0 || 8 || 428 || 428 || 428.0 || 0.018264 || 0.000888 || 0.004188142857142856
+
| 400 || 490.365970 || 49357881 || 93.101481 || 49351626
 
|-
 
|-
| 423 || 4662 || 22 || 0 || 22 || 507 || 399 || 490.0 || 0.033772 || 0.000353 || 0.008025714285714285
+
| 500 || 434.921334 || 49347357 || 93.119187 || 49351049
 
|-
 
|-
| 424 || 4573 || 82 || 5 || 77 || 35277 || 402 || 22154.0 || 2.837039 || 0.00038 || 0.1992594567901235
+
| 600 || 466.822803 || 49361647 || 96.243807 || 49345030
 
|-
 
|-
| 425 || 4818 || 89 || 5 || 84 || 35182 || 806 || 27487.0 || 2.668561 || 0.000923 || 0.2510617159090909
+
| 700 || 425.273205 || 49360615 || 97.721654 || 49346798
 
|-
 
|-
| 426 || 4656 || 75 || 4 || 71 || 33359 || 399 || 26972.0 || 3.605494 || 0.000393 || 0.23070352702702704
+
| 800 || 434.638603 || 49349629 || 96.723318 || 49341034
 
|-
 
|-
| 427 || 4733 || 85 || 6 || 79 || 35186 || 803 || 26906.0 || 2.148385 || 0.001151 || 0.2534797261904762
 
|-
 
| 428 || 4791 || 43 || 0 || 43 || 824 || 410 || 598.0 || 0.061868 || 0.000381 || 0.012763071428571426
 
|-
 
| 429 || 4801 || 50 || 0 || 50 || 828 || 418 || 692.0 || 0.105314 || 0.000458 || 0.01660542857142857
 
|-
 
| 430 || 4864 || 39 || 0 || 39 || 813 || 417 || 708.0 || 0.077749 || 0.000402 || 0.011219026315789474
 
|-
 
| 431 || 4819 || 47 || 0 || 47 || 830 || 419 || 704.0 || 0.12412 || 0.000404 || 0.01775360869565218
 
|-
 
| 432 || 4802 || 10 || 0 || 10 || 412 || 412 || 412.0 || 0.032166 || 0.001549 || 0.017082666666666666
 
|-
 
| 433 || 4539 || 28 || 1 || 27 || 389 || 389 || 389.0 || 0.03609 || 0.000333 || 0.007853185185185185
 
|-
 
| 434 || 4879 || 4 || 0 || 4 || 419 || 419 || 419.0 || 0.006336 || 0.001397 || 0.003171666666666667
 
|-
 
| 435 || 4611 || 14 || 0 || 14 || 395 || 395 || 395.0 || 0.032176 || 0.000359 || 0.004410692307692308
 
|-
 
| 436 || 4963 || 4 || 0 || 4 || 426 || 426 || 426.0 || 0.027804 || 0.003123 || 0.018338666666666666
 
|-
 
| 437 || 4680 || 13 || 0 || 13 || 401 || 401 || 401.0 || 0.053547 || 0.000353 || 0.014278583333333332
 
|-
 
| 438 || 5121 || 1 || 0 || 1
 
|-
 
| 439 || 4895 || 6 || 0 || 6 || 419 || 419 || 419.0 || 0.002139 || 0.000369 || 0.0009146
 
|-
 
| 440 || 4603 || 51 || 5 || 46 || 8138 || 394 || 7770.0 || 0.621619 || 0.000386 || 0.11887989999999997
 
|-
 
| 441 || 4716 || 59 || 6 || 53 || 27410 || 26301 || 27193.0 || 2.486348 || 0.040779 || 0.2281169827586206
 
|-
 
| 442 || 4632 || 26 || 0 || 26 || 397 || 397 || 397.0 || 0.074324 || 0.000361 || 0.007343720000000001
 
|-
 
| 443 || 4744 || 32 || 0 || 32 || 416 || 415 || 416.0 || 0.039913 || 0.000351 || 0.006988709677419356
 
|-
 
| 444 || 4702 || 25 || 0 || 25 || 457 || 403 || 451.0 || 0.043997 || 0.0004 || 0.013928625
 
|-
 
| 445 || 4706 || 30 || 0 || 30 || 664 || 650 || 661.0 || 0.112822 || 0.000748 || 0.017773827586206895
 
|-
 
| 446 || 4859 || 12 || 0 || 12 || 417 || 417 || 417.0 || 0.031074 || 0.000372 || 0.004786181818181818
 
|-
 
| 447 || 4733 || 16 || 0 || 16 || 405 || 405 || 405.0 || 0.033453 || 0.000516 || 0.006051666666666667
 
|-
 
| 448 || 4897 || 107 || 6 || 101 || 35565 || 33683 || 34325.0 || 2.645486 || 0.048617 || 0.2759087735849056
 
|-
 
| 449 || 4650 || 117 || 2 || 115 || 35626 || 787 || 11202.0 || 1.791986 || 0.000833 || 0.06600013793103447
 
|-
 
| 450 || 5058 || 109 || 4 || 105 || 35732 || 831 || 12667.0 || 2.009291 || 0.000859 || 0.11539344444444445
 
|-
 
| 451 || 4974 || 123 || 4 || 119 || 35507 || 434 || 14205.0 || 1.231043 || 0.000446 || 0.09115389344262297
 
|-
 
| 452 || 5005 || 122 || 1 || 121 || 35599 || 832 || 7269.0 || 1.296529 || 0.000915 || 0.0766922561983471
 
|-
 
| 453 || 4770 || 127 || 6 || 121 || 35574 || 417 || 12855.0 || 3.740406 || 0.000396 || 0.12524660317460318
 
|-
 
| 454 || 5064 || 122 || 4 || 118 || 35542 || 442 || 12207.0 || 1.872247 || 0.000406 || 0.09492408264462804
 
|-
 
| 455 || 4957 || 130 || 5 || 125 || 35538 || 424 || 14981.0 || 1.966265 || 0.000435 || 0.14356921705426354
 
|-
 
| 456 || 4554 || 86 || 5 || 81 || 34474 || 397 || 19853.0 || 2.973064 || 0.000401 || 0.15387572941176472
 
|-
 
| 457 || 4677 || 46 || 0 || 46 || 723 || 401 || 519.0 || 0.085646 || 0.000392 || 0.011321000000000003
 
|-
 
| 458 || 4732 || 89 || 4 || 85 || 30690 || 411 || 18431.0 || 1.739284 || 0.000686 || 0.12749639772727275
 
|-
 
| 459 || 4695 || 48 || 0 || 48 || 498 || 403 || 445.0 || 0.070023 || 0.000396 || 0.00976304255319149
 
|-
 
| 460 || 4533 || 88 || 6 || 82 || 35102 || 397 || 21665.0 || 3.031303 || 0.00034 || 0.17297327586206898
 
|-
 
| 461 || 4772 || 45 || 0 || 45 || 830 || 409 || 634.0 || 0.13479 || 0.000348 || 0.017723477272727273
 
|-
 
| 462 || 4644 || 90 || 4 || 86 || 27091 || 400 || 18316.0 || 2.759531 || 0.000395 || 0.1462850786516854
 
|-
 
| 463 || 4641 || 46 || 0 || 46 || 453 || 398 || 429.0 || 0.104275 || 0.000357 || 0.007952155555555554
 
|-
 
| 464 || 4788 || 82 || 4 || 78 || 35243 || 419 || 22832.0 || 1.589552 || 0.000755 || 0.18275070370370367
 
|-
 
| 465 || 4735 || 86 || 4 || 82 || 34216 || 412 || 21257.0 || 3.345671 || 0.000393 || 0.2542693764705883
 
|-
 
| 466 || 4892 || 48 || 0 || 48 || 832 || 419 || 617.0 || 0.048519 || 0.000446 || 0.013317765957446806
 
|-
 
| 467 || 4819 || 49 || 0 || 49 || 726 || 413 || 554.0 || 0.038178 || 0.000361 || 0.0082098125
 
|-
 
| 468 || 4822 || 83 || 5 || 78 || 34963 || 420 || 22461.0 || 2.44696 || 0.000458 || 0.20808632926829274
 
|-
 
| 469 || 4702 || 84 || 5 || 79 || 29335 || 407 || 24187.0 || 2.070507 || 0.000404 || 0.1608520240963856
 
|-
 
| 470 || 4645 || 44 || 0 || 44 || 758 || 399 || 593.0 || 0.05755 || 0.000389 || 0.01065479069767442
 
|-
 
| 471 || 4582 || 45 || 0 || 45 || 515 || 394 || 476.0 || 0.034257 || 0.000358 || 0.006913636363636363
 
|-
 
| 472 || 4662 || 60 || 5 || 55 || 11136 || 491 || 8511.0 || 1.083163 || 0.000576 || 0.1518878813559322
 
|-
 
| 473 || 4734 || 31 || 0 || 31 || 406 || 406 || 406.0 || 0.048088 || 0.000472 || 0.010535466666666667
 
|-
 
| 474 || 4866 || 33 || 0 || 33 || 417 || 417 || 417.0 || 0.038007 || 0.000418 || 0.009182343750000002
 
|-
 
| 475 || 4893 || 17 || 0 || 17 || 419 || 419 || 419.0 || 0.06294 || 0.000539 || 0.0093403125
 
|-
 
| 476 || 4484 || 58 || 7 || 51 || 5364 || 419 || 5145.0 || 0.261769 || 0.000609 || 0.047153982456140345
 
|-
 
| 477 || 4727 || 29 || 0 || 29 || 405 || 405 || 405.0 || 0.034762 || 0.000366 || 0.0063151785714285705
 
|-
 
| 478 || 4697 || 31 || 0 || 31 || 403 || 403 || 403.0 || 0.028912 || 0.000386 || 0.0056612
 
|-
 
| 479 || 4925 || 16 || 0 || 16 || 422 || 422 || 422.0 || 0.042014 || 0.000402 || 0.009589733333333333
 
|-
 
| 480 || 4768 || 93 || 7 || 86 || 35230 || 417 || 18915.0 || 1.356041 || 0.000426 || 0.11487182608695652
 
|-
 
| 481 || 4712 || 92 || 7 || 85 || 35223 || 411 || 24164.0 || 1.253467 || 0.000408 || 0.13666809890109888
 
|-
 
| 482 || 4747 || 92 || 4 || 88 || 35260 || 415 || 23816.0 || 4.385892 || 0.000431 || 0.2551370549450549
 
|-
 
| 483 || 4810 || 92 || 5 || 87 || 35180 || 420 || 27049.0 || 2.063221 || 0.000409 || 0.20561160439560433
 
|-
 
| 484 || 4779 || 52 || 0 || 52 || 831 || 410 || 545.0 || 0.109925 || 0.000376 || 0.013762313725490201
 
|-
 
| 485 || 5030 || 51 || 0 || 51 || 854 || 431 || 657.0 || 0.113004 || 0.000493 || 0.011624299999999999
 
|-
 
| 486 || 4864 || 51 || 0 || 51 || 838 || 417 || 626.0 || 0.108181 || 0.000395 || 0.01531288
 
|-
 
| 487 || 4769 || 49 || 0 || 49 || 829 || 410 || 690.0 || 0.168691 || 0.000383 || 0.017501604166666667
 
|-
 
| 488 || 4529 || 64 || 6 || 58 || 34834 || 782 || 28737.0 || 0.840911 || 0.000907 || 0.15293260317460325
 
|-
 
| 489 || 4700 || 31 || 0 || 31 || 806 || 411 || 712.0 || 0.064498 || 0.000452 || 0.013004799999999999
 
|-
 
| 490 || 4534 || 66 || 5 || 61 || 26892 || 504 || 23483.0 || 1.320047 || 0.000522 || 0.14104806153846153
 
|-
 
| 491 || 4722 || 32 || 0 || 32 || 509 || 405 || 491.0 || 0.043317 || 0.0004 || 0.009192580645161293
 
|-
 
| 492 || 4762 || 33 || 0 || 33 || 817 || 414 || 715.0 || 0.13401 || 0.000606 || 0.018534718749999995
 
|-
 
| 493 || 4914 || 16 || 0 || 16 || 430 || 420 || 427.0 || 0.032486 || 0.000537 || 0.011139133333333336
 
|-
 
| 494 || 4825 || 33 || 0 || 33 || 737 || 415 || 675.0 || 0.095071 || 0.000385 || 0.0099645
 
|-
 
| 495 || 4936 || 15 || 0 || 15 || 424 || 423 || 424.0 || 0.030645 || 0.00039 || 0.01171842857142857
 
|-
 
| 496 || 4563 || 62 || 5 || 57 || 30962 || 750 || 28752.0 || 2.497906 || 0.001256 || 0.2965245409836066
 
|-
 
| 497 || 4604 || 59 || 6 || 53 || 21928 || 502 || 20663.0 || 0.991498 || 0.000552 || 0.12354541379310344
 
|-
 
| 498 || 4704 || 33 || 0 || 33 || 443 || 404 || 438.0 || 0.039556 || 0.000417 || 0.010182187499999999
 
|-
 
| 499 || 4581 || 32 || 0 || 32 || 395 || 393 || 395.0 || 0.030057 || 0.000359 || 0.005512225806451612
 
|-
 
| 500 || 4679 || 32 || 0 || 32 || 709 || 407 || 666.0 || 0.08843 || 0.000411 || 0.01497041935483871
 
|-
 
| 501 || 4697 || 29 || 0 || 29 || 583 || 404 || 567.0 || 0.041782 || 0.000377 || 0.008812607142857143
 
|-
 
| 502 || 4859 || 17 || 0 || 17 || 416 || 416 || 416.0 || 0.02546 || 0.000419 || 0.004625125
 
|-
 
| 503 || 4940 || 15 || 0 || 15 || 423 || 423 || 423.0 || 0.029683 || 0.000334 || 0.006086142857142858
 
|-
 
| 504 || 4587 || 41 || 4 || 37 || 2074 || 1818 || 2041.0 || 0.08827 || 0.002139 || 0.0208681
 
|-
 
| 505 || 4644 || 20 || 0 || 20 || 398 || 398 || 398.0 || 0.016099 || 0.000404 || 0.003742052631578947
 
|-
 
| 506 || 4663 || 22 || 0 || 22 || 400 || 400 || 400.0 || 0.038095 || 0.000426 || 0.008067095238095238
 
|-
 
| 507 || 4810 || 11 || 0 || 11 || 412 || 412 || 412.0 || 0.022261 || 0.000391 || 0.0048446999999999995
 
|-
 
| 508 || 4595 || 20 || 0 || 20 || 405 || 401 || 404.0 || 0.031597 || 0.000323 || 0.008233894736842103
 
|-
 
| 509 || 4723 || 9 || 0 || 9 || 404 || 404 || 404.0 || 0.036299 || 0.000321 || 0.011594375
 
|-
 
| 510 || 4803 || 10 || 0 || 10 || 411 || 411 || 411.0 || 0.029019 || 0.000336 || 0.005391999999999999
 
|-
 
| 511 || 5033 || 4 || 0 || 4 || 430 || 430 || 430.0 || 0.002389 || 0.000346 || 0.0010416666666666667
 
 
|}
 
|}
  
=== 40 MPI ranks depth: 4 ===
+
[[File:PDR.png]]
 
 
[[File:PDR PODM Histogram Time 40.png| 700px]]
 
[[File:PDR PODM Histrogram Tasks 40.png| 700px]]
 

Latest revision as of 14:49, 19 May 2023

Issues

  • No reuse of leaves refined by worker nodes. The picture below shows the issue. Two neighbour leaves (0,1) each refined as the main leaf (0 top, 1 bottom) but not refined as a neighor.

PDR PODM Leaves not refined.png

  • Current algorithm uses neighbour traversal to distribute cells to octree leaving some cells out in some cases. Such a case can happen when a cell is part of an octree leaf based on its circumcenter but

it does not have any neighbour in the same leaf.

PDR PODM Cells not distributed.png

  • During unpacking the incident cell for each vertex is not set correctly. Specifically, in the case that the initial incident cell is not part of the working unit (Leaf + LVL.1 Neighbours) and thus is not local,

it is set to the infinite cell. This causes PODM to crash randomly for some cases.

  • Another issue comes from the way global IDs are updated for each cell's neighbors' IDs. The code that updates the cell's connectivity using global IDs takes the neighbor's pointer, retrieves its global ID and

updates the neighborID field. However, when the neighbour is part of another work unit's leaf and is not local this pointer is NULL. In this case the neighborID field is wrongly reset to the infinite cell ID, which as result, deletes the connectivity information forever.

  • The function that unpacks the required leaves before refinement does not discard duplicate vertices. Duplicate vertices will always be present since each leaf is packed and sent individually, and as a result,

neighbouring leaves will include the shared vertices. Because duplicate vertices are not handled, multiple vertex objects are created that are in fact the same point geometrically. Thus, two cells that share a common vertex could have pointers to two different vertex objects and, as a result, each cell views a different state about the same vertex.

Fixes

PDR Fix.png

Work Unit After Refinement.png


Interesting Findings

Delta 0.880

15 MPI ranks depth: 3


PDR PODM Histogram Time 15 d3.png PDR PODM Histogram Tasks 15 d3.png PDR PODM Time Break Down 15 d3.png

PDR PODM Parallelism.png PDR PODM Histogram 15.png

15 MPI ranks depth: 4


PDR PODM Histogram Time 15.png PDR PODM Histogram Tasks 15.png PDR PODM Time Break Down 15.png

40 MPI ranks / 40 cores depth: 4

Total Time: 824.29

Total Tasks: 11413

PDR PODM Histogram Time 40.png PDR PODM Histrogram Tasks 40.png PDR PODM Time Break Down 40.png

160 MPI ranks / 10 cores depth: 4

Total Time: 378.32

Total Tasks: 12652

PDR PODM Histogram Time 160 10.png PDR PODM Histrogram Tasks 160 10.png PDR PODM Time Break Down 160 10.png

After Parallel int to pointer

15 MPI ranks depth: 3


PDR PODM Histogram Time 15 d3 par int2ptr.png PDR PODM Histogram Tasks 15 d3 par int2ptr.png


Sequential Parallel
PDR PODM Time Break Down 15 d3.png PDR PODM Time Break Down 15 d3 par int2ptr.png

15 MPI ranks depth: 4

Total time: 569.7

Total tasks: 8761

PDR PODM Histogram Time 15 par int2ptr.png PDR PODM Histogram Tasks 15 par int2ptr.png


Sequential Parallel
PDR PODM Time Break Down 15.png PDR PODM Time Break Down 15 par int2ptr.png

40 MPI ranks depth: 4

Total time: 326.5

Total tasks: 11201

PDR PODM Histogram Time 40 par int2ptr.png PDR PODM Histogram Tasks 40 par int2ptr.png


Sequential Parallel
PDR PODM Time Break Down 40.png PDR PODM Time Break Down 40 par int2ptr.png

160 MPI ranks 10 cores depth: 4

Total time: 264.3

Total tasks: 12826

PDR PODM Histogram Time 160 10 par int2ptr.png PDR PODM Histogram Tasks 160 10 par int2ptr.png


Sequential Parallel
PDR PODM Time Break Down 160 10.png PDR PODM Time Break Down 160 10 par int2ptr.png

After Parallel int to pointer and leaf distribution

15 MPI ranks depth: 4

Total time: 452.3

Total tasks: 8813

PDR PODM Histogram Time 15 par int2ptr leaf dist bad elements.png PDR PODM Histogram Tasks 15 par int2ptr leaf dist bad elements.png


Sequential Parallel(int2ptr) Parallel(leafDist,BadEl)
PDR PODM Time Break Down 15.png PDR PODM Time Break Down 15 par int2ptr.png PDR PODM Time Break Down 15 par int2ptr leaf dist bad elements.png

40 MPI ranks depth: 4

Total time: 271.9

Total tasks: 11455

PDR PODM Histogram Time 40 par int2ptr leaf dist bad elements.png PDR PODM Histogram Tasks 40 par int2ptr leaf dist bad elements.png


Sequential Parallel(int2ptr) Parallel(leafDist,BadEl)
PDR PODM Time Break Down 40.png PDR PODM Time Break Down 40 par int2ptr.png PDR PODM Time Break Down 40 par int2ptr leaf dist bad elements.png

160 MPI ranks 10 cores depth: 4

Total time: 218.3

Total tasks: 12517

PDR PODM Histogram Time 160 10 par int2ptr leaf dist bad elements.png PDR PODM Histrogram Tasks 160 10 par int2ptr leaf dist bad elements.png

Sequential Parallel(int2ptr) Parallel(leafDist,BadEl)
PDR PODM Time Break Down 160 10.png PDR PODM Time Break Down 160 10 par int2ptr.png PDR PODM Time Break Down 160 10 par int2ptr leaf dist bad elements.png

After Parallel int to pointer, leaf distribution and extra comm thread

15 MPI ranks depth: 3

Total time: 1144.7

Total tasks: 1830

PDR PODM Histogram Time 15 d3 par int2ptr leaf dist bad elements comm thread.png PDR PODM Histrogram Tasks 15 d3 par int2ptr leaf dist bad elements comm thread.png


Sequential Parallel(best) Parallel(best+comm_thread)
PDR PODM Time Break Down 15 d3.png 500px PDR PODM Time Break Down 15 d3 par int2ptr leaf dist bad elements comm thread.png

15 MPI ranks depth: 4

Total time: 354.6

Total tasks: 8892

PDR PODM Histogram Time 15 par int2ptr leaf dist bad elements comm thread.png PDR PODM Histrogram Tasks 15 par int2ptr leaf dist bad elements comm thread.png


Sequential Parallel(best) Parallel(best+comm_thread)
PDR PODM Time Break Down 15.png PDR PODM Time Break Down 15 par int2ptr leaf dist bad elements.png PDR PODM Time Break Down 15 par int2ptr leaf dist bad elements comm thread.png

40 MPI ranks depth: 4

Total time: 208.3

Total tasks: 11468


PDR PODM Histogram Time 40 par int2ptr leaf dist bad elements comm thread.png PDR PODM Histrogram Tasks 40 par int2ptr leaf dist bad elements comm thread.png


Sequential Parallel(best) Parallel(best+comm_thread)
PDR PODM Time Break Down 40.png PDR PODM Time Break Down 40 par int2ptr leaf dist bad elements.png PDR PODM Time Break Down 40 par int2ptr leaf dist bad elements comm thread.png

160 MPI ranks depth: 4

Total time: 202.2

Total tasks: 12715


PDR PODM Histogram Time 160 10 par int2ptr leaf dist bad elements comm thread.png PDR PODM Histrogram Tasks 160 10 par int2ptr leaf dist bad elements comm thread.png


Sequential Parallel(best) Parallel(best+comm_thread)
PDR PODM Time Break Down 160 10.png PDR PODM Time Break Down 160 10 par int2ptr leaf dist bad elements.png PDR PODM Time Break Down 160 10 par int2ptr leaf dist bad elements comm thread.png

Delta 0.3780

15 MPI ranks depth: 4


PDR PODM Histogram Time small delta 15.png PDR PODM Histogram Tasks small delta 15.png PDR PODM Time Break Down small delta 15.png


Latest Results

Shared MemoryTimes
Cores Total Time (s) Number of Elements
40 90.8 49453719


MPI Times
MPI PREMA
Cores Total Time (s) Number of Elements Total Time (s) Number of Elements
100 1151.472406 49352359 208.746450 49347855
200 763.70671 49357898 121.326012 49353442
300 537.678638 49357092 105.812248 49351224
400 490.365970 49357881 93.101481 49351626
500 434.921334 49347357 93.119187 49351049
600 466.822803 49361647 96.243807 49345030
700 425.273205 49360615 97.721654 49346798
800 434.638603 49349629 96.723318 49341034

PDR.png