Internal:ReportCloud: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| (31 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
==CBC3D== | ==CBC3D== | ||
===Procedure for Aneurysm meshes=== | |||
# High memory node on Turing acquired. | |||
# Activated the topology checks for the image and the mesh. | # Activated the topology checks for the image and the mesh. | ||
# Generation | # Generation of meshes for: | ||
#* Stent | #* Stent | ||
#* Aneurysm + Stent | #* Aneurysm + Stent | ||
# | #* Aneurysm | ||
# Aneurysm mesh: | |||
#* Preprocessing for the initial image of the aneurysm to be acquired: | #* Preprocessing for the initial image of the aneurysm to be acquired: | ||
#** Combination of the slices to transform from 2D to 3D image | #** Combination of the slices to transform from 2D to 3D image. | ||
#** Relabeled the areas of the image where the label was set to stent, now to the label of the aneurysm | #** Relabeled the areas of the image where the label was set to stent, now to the label of the aneurysm. | ||
#* | #* Run the image as input to CBC3D on Turing: | ||
#** Parameters: | #** Parameters: | ||
{| class="wikitable" | {| class="wikitable" | ||
!NumIterations||NonConnectivity||Fidelity||LatticeSpacing | |||
|- | |- | ||
|7||3||0.95||0.15 | |7||3||0.95||0.15 | ||
|} | |} | ||
Final: Extracted surface of the meshes and transformed to STL. | |||
==NRR== | ==NRR== | ||
| Line 21: | Line 26: | ||
===Preliminary Results=== | ===Preliminary Results=== | ||
The MPI Driver is currently running on crtc-gpu.cs.odu.edu. It has run 3702 iterations. | The MPI Driver is currently running on crtc-gpu.cs.odu.edu. It has run 3702 iterations of Media Case 17. | ||
Current best results: | Current best results (better than HD=4.25 of Media paper): | ||
{| class="wikitable" | {| class="wikitable" | ||
|HD|| | |HD||BlockSizeX||BlockSizeY||BlockSizeZ||WindowSizeX||WindowSizeY||WindowSizeZ||nonConnectivity||selectionFraction||numApproxSteps||numInterSteps||numAdaptiveIterations||zeroBlocksFraction||rejectionFraction | ||
|- | |||
|2.18||1||1||1||3||3||2||2||0.15||10||1||5||0.00001||0.2 | |||
|- | |||
|2.44||1||1||1||3||3||2||2||0.10||9||0||5||0.00001||0.2 | |||
|- | |||
|2.63||1||1||1||3||3||1||2||0.05||10||0||5||0.0001||0.35 | |||
|- | |||
|3.19||1||1||1||3||3||1||2||0.05||9||1||5||0.001||0.2 | |||
|- | |||
|3.30||1||1||1||3||3||1||2||0.10||9||0||5||0.00001||0.35 | |||
|- | |||
|3.42||1||1||1||3||3||1||2||0.10||9||0||5||0.0001||0.25 | |||
|- | |||
|3.57||1||1||1||3||3||1||2||0.10||9||0||5||0.0001||0.20 | |||
|- | |||
|3.61||1||1||1||3||3||1||2||0.05||9||0||4||0.00001||0.20 | |||
|- | |||
|3.83||1||1||1||3||3||1||2||0.05||9||0||3||0.0001||0.35 | |||
|- | |- | ||
|2. | |4.04||1||1||1||3||3||1||2||0.05||9||0||3||0.001||0.20 | ||
|} | |} | ||
| Line 39: | Line 62: | ||
# Discussed the required script modifications for PAPBNRR with Angelos. | # Discussed the required script modifications for PAPBNRR with Angelos. | ||
# Locate process pinning within ITK (Fotis' version) | # Locate process pinning within ITK (Fotis' version) | ||
#* This | #* This had been temporarily resolved by reserving an entire node on Turing | ||
#* Modifications to ITK to remove pinning are | #* Modifications to ITK to remove pinning are complete. | ||
# Focus is currently on reduction of intermediary temporary files | # Focus is currently on reduction of intermediary temporary files | ||
## Locate where files are first written and remove need for empty initial files | ## Locate where files are first written and remove need for empty initial files | ||
| Line 49: | Line 72: | ||
###* (Possible alternative) Based on Fotis' suggestion VTK structures might be replaced by ITK structures. | ###* (Possible alternative) Based on Fotis' suggestion VTK structures might be replaced by ITK structures. | ||
### keep data structures in memory between PAPBNRR iterations. | ### keep data structures in memory between PAPBNRR iterations. | ||
# Completed: | |||
#* Detailed installation instructions of NRR code (including ITK, VTK, CGAL, PODM, CBC3D) | |||
#* MPI code to run multiple instances | |||
#* Files-Memory: | |||
## Files produced during execution of NRR:Found how to keep them only in memory, the files don’t need to be written - In progress | |||
## Files passed between NRR (Image) and PODM (Mesh) - Conversion: In progress | |||
| Line 56: | Line 86: | ||
# Review the scripts created by Angelos (Accessible Friday, 6 April, afternoon). | # Review the scripts created by Angelos (Accessible Friday, 6 April, afternoon). | ||
# Explore feasibility of the gnu parallel utility within Angelos' SLURM scripts. | # Explore feasibility of the gnu parallel utility within Angelos' SLURM scripts. | ||
# Modify MPI driver to archive output ( | # Modify MPI driver to archive output (mesh, deformation field, HD) for each job | ||
# Explore Python Multi-threaded driver | # Explore Python Multi-threaded driver | ||
These items are short term expected to be complete end of day Monday, 9 April. | These items are short term expected to be complete end of day Monday, 9 April. | ||
==Cloud Compute Platforms== | |||
This section documents the current research into Cloud Compute services. Currently this includes only AWS. | |||
===AWS Reference Materials=== | |||
* [https://aws.amazon.com/blogs/aws/aws-batch-run-batch-computing-jobs-on-aws/ AWS Overview] | |||
* [https://aws.amazon.com/batch/getting-started/ AWS Getting Started] | |||
* [https://docs.aws.amazon.com/batch/latest/userguide/Batch_GetStarted.html AWS Batch Jobs] | |||
* [https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-welcome.html AWS Command Line] | |||
Latest revision as of 22:08, 18 May 2018
CBC3D
Procedure for Aneurysm meshes
- High memory node on Turing acquired.
- Activated the topology checks for the image and the mesh.
- Generation of meshes for:
- Stent
- Aneurysm + Stent
- Aneurysm
- Aneurysm mesh:
- Preprocessing for the initial image of the aneurysm to be acquired:
- Combination of the slices to transform from 2D to 3D image.
- Relabeled the areas of the image where the label was set to stent, now to the label of the aneurysm.
- Run the image as input to CBC3D on Turing:
- Parameters:
- Preprocessing for the initial image of the aneurysm to be acquired:
| NumIterations | NonConnectivity | Fidelity | LatticeSpacing |
|---|---|---|---|
| 7 | 3 | 0.95 | 0.15 |
Final: Extracted surface of the meshes and transformed to STL.
NRR
Preliminary Results
The MPI Driver is currently running on crtc-gpu.cs.odu.edu. It has run 3702 iterations of Media Case 17.
Current best results (better than HD=4.25 of Media paper):
| HD | BlockSizeX | BlockSizeY | BlockSizeZ | WindowSizeX | WindowSizeY | WindowSizeZ | nonConnectivity | selectionFraction | numApproxSteps | numInterSteps | numAdaptiveIterations | zeroBlocksFraction | rejectionFraction |
| 2.18 | 1 | 1 | 1 | 3 | 3 | 2 | 2 | 0.15 | 10 | 1 | 5 | 0.00001 | 0.2 |
| 2.44 | 1 | 1 | 1 | 3 | 3 | 2 | 2 | 0.10 | 9 | 0 | 5 | 0.00001 | 0.2 |
| 2.63 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.05 | 10 | 0 | 5 | 0.0001 | 0.35 |
| 3.19 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.05 | 9 | 1 | 5 | 0.001 | 0.2 |
| 3.30 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.10 | 9 | 0 | 5 | 0.00001 | 0.35 |
| 3.42 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.10 | 9 | 0 | 5 | 0.0001 | 0.25 |
| 3.57 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.10 | 9 | 0 | 5 | 0.0001 | 0.20 |
| 3.61 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.05 | 9 | 0 | 4 | 0.00001 | 0.20 |
| 3.83 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.05 | 9 | 0 | 3 | 0.0001 | 0.35 |
| 4.04 | 1 | 1 | 1 | 3 | 3 | 1 | 2 | 0.05 | 9 | 0 | 3 | 0.001 | 0.20 |
Current Work
The ongoing work and completed work includes:
- Discussed PAPBNRR compilation with Angelos.
- Angelos compiled everything successfully
- Discussed the required script modifications for PAPBNRR with Angelos.
- Locate process pinning within ITK (Fotis' version)
- This had been temporarily resolved by reserving an entire node on Turing
- Modifications to ITK to remove pinning are complete.
- Focus is currently on reduction of intermediary temporary files
- Locate where files are first written and remove need for empty initial files
- Locate where files are read/used
- The goal is to keep structures in memory and
- pass the in-memory structures between PAPBNRR and Mesh generators (PODM, CBC3D).
- Implement converters to transform the data structures from PODM/CBC3D into the format used by PAPBNRR.
- (Possible alternative) Based on Fotis' suggestion VTK structures might be replaced by ITK structures.
- keep data structures in memory between PAPBNRR iterations.
- Completed:
- Detailed installation instructions of NRR code (including ITK, VTK, CGAL, PODM, CBC3D)
- MPI code to run multiple instances
- Files-Memory:
- Files produced during execution of NRR:Found how to keep them only in memory, the files don’t need to be written - In progress
- Files passed between NRR (Image) and PODM (Mesh) - Conversion: In progress
Action Items
The current (i.e., immediate) action items include:
- Review the scripts created by Angelos (Accessible Friday, 6 April, afternoon).
- Explore feasibility of the gnu parallel utility within Angelos' SLURM scripts.
- Modify MPI driver to archive output (mesh, deformation field, HD) for each job
- Explore Python Multi-threaded driver
These items are short term expected to be complete end of day Monday, 9 April.
Cloud Compute Platforms
This section documents the current research into Cloud Compute services. Currently this includes only AWS.