Article

Applications of Algebraic Multigrid to Large-Scale Finite Element Analysis of Whole Bone Micro-Mechanics on the IBM SP

Authors:

Harun H. Bayraktar,

Tony M. Keaveny,

Panayiotis PapdopoulosAuthors Info & Claims

SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing

Page 26

https://doi.org/10.1145/1048935.1050177

Published: 15 November 2003 Publication History

Abstract

Accurate micro-finite element analyses of whole bones require the solution of large sets of algebraic equations. Multigrid has proven to be an effective approach to the design of highly scalable linear solvers for solid mechanics problems. We present some of the first applications of scalable linear solvers, on massively parallel computers, to whole vertebral body structural analysis. We analyze the performance of our algebraic multigrid (AMG) methods on problems with over 237 million degrees of freedom on IBM SP parallel computers. We demonstrate excellent parallel scalability, both in the algorithms and the implementations, and analyze the nodal performance of the important AMG kernels on the IBM Power3 and Power4 architectures.

References

[1]

{1} M. F. ADAMS, A distributed memory unstructured Gauss-Seidel algorithm for multigrid smoothers, in ACM/IEEE Proceedings of SC01: High Performance Networking and Computing, 2001.

Digital Library

[2]

{2} M. F. ADAMS, Evaluation of three unstructured multigrid methods on 3D finite element problems in solid mechanics, International Journal for Numerical Methods in Engineering, 55 (2002), pp. 519-534.

[3]

{3} M. F. ADAMS, M. BREZINA, J. J. HU, AND R. S. TUMINARO, Parallel multigrid smoothing: polynomial versus Gauss-Seidel, Journal of Computational Physics, 188 (2003), pp. 593-610.

Digital Library

[4]

{4} S. BALAY, W. D. GROPP, L. C. MCINNES, AND B. F. SMITH, PETSc 2.0 users manual, tech. report, Argonne National Laboratory, 1996.

[5]

{5} H. H. BAYRAKTAR, M. F. ADAMS, A. GUPTA, P. PAPADOPOULOS, AND T. M. KEAVENY, The role of large deformations in trabecular bone mechanical behavior, in ASME Bioengineering Conference, Key Biscayne, FL, 2003, pp. 31-32.

[6]

{6} H. H. BAYRAKTAR, J. M. BUCKLEY, M. F. ADAMS, A. GUPTA, P. F. HOFFMANN, D. C. LEE, P. PAPADOPOULOS, AND T. M. KEAVENY, Cortical shell thickness and its contribution to vertebral body stiffness, in ASME Bioengineering Conference, Key Biscayne, FL, 2003, pp. 115-116.

[7]

{7} H. H. BAYRAKTAR, A. GUPTA, R. Y. KWON, AND T. M. KEAVENY, Multiaxial failure behavior of human femoral trabecular bone, in Transactions of the Orthopaedic Research Society, vol. 28, New Orleans, 2003, p. 202.

[8]

{8} H. H. BAYRAKTAR, E. F. MORGAN, G. L. NIEBUR, G. E. MORRIS, E. K. WONG, AND T. M. KEAVENY, Comparison of the elastic and yield properties of human femoral trabecular and cortical bone tissue, Journal of Biomechanics, (2003). In Press.

[9]

{9} D. BRAESS, On the combination of the multigrid method and conjugate gradients, in Multigrid Methods II, W. Hackbusch and U. Trottenberg, eds., Berlin, 1986, Springer-Verlag, pp. 52-64.

[10]

{10} A. BRANDT, Multi-level adaptive solutions to boundary value problems, Math. Comput., 31 (1977), pp. 333-390.

[11]

{11} W. L. BRIGGS, V. E. HENSON, AND S. MCCORMICK, A multigrid tutorial, Second Edition, SIAM, Philadelphia, 2000.

Digital Library

[12]

{12} V. E. BULGAKOV AND G. KUHN, High-performance multilevel iterative aggregation solver for large finite-element structural analysis problems, International Journal for Numerical Methods in Engineering, 38 (1995), pp. 3529-3544.

[13]

{13} S. C. COWIN, ed., Bone Mechanics Handbook, CRC Press, Boca Raton, 2 ed., 2001.

[14]

{14} C. FARHAT AND F.-X. ROUX, A method of finite element tearing and interconnecting and its parallel solution algorithm, International Journal for Numerical Methods in Engineering, 32 (1991), pp. 1205-1227.

[15]

{15} FEAP. www.ce.berkeley.edu/~rlt.

[16]

{16} J. FISH AND V. BELSKY, Generalized aggregation multilevel solver, International Journal for Numerical Methods in Engineering, 40 (1997), pp. 4341-4361.

[17]

{17} D. P. FYHRIE AND M. B. SCHAFFLER, Failure mechanisms in human vertebral cancellous bone, Bone, 15 (1994), pp. 105-9.

[18]

{18} R. GULDBERG, S. HOLLISTER, AND G. CHARRAS, The accuracy of digital image-based finite element models., Journal of Biomechanical Engineering, 120 (1998), pp. 289-295.

[19]

{19} W. HACKBUSCH, Multigrid methods and applications, vol. 4 of Computational Mathematics, Springer-Verlag, Berlin, 1985.

[20]

{20} T. J. R. HUGHES, R. M. FERENCZ, AND J. O. HALLQUIST, Large-scale vectorized implicit calculation in solid mechanics on a cray x-mp/48 utilizing ebe preconditioned conjugate gradients, Computer Methods in Applied Mechanics and Engineering, 61 (1987), pp. 215-248.

Digital Library

[21]

{21} G. KARYPIS AND V. KUMAR, Parallel multilevel k-way partitioning scheme for irregular graphs, ACM/IEEE Proceedings of SC96: High Performance Networking and Computing, (1996).

Digital Library

[22]

{22} T. M. KEAVENY, Bone Mechanics Handbook, CRC Press, Boca Raton, 2 ed., 2001, ch. 16, pp. 1-42.

[23]

{23} M. M. BHARDWAJ, K. PIERSON, G. REESE, T. WALSH, D. Day, K. ALVIN, AND J. PEERY, Salinas: A scalable software for high-performance structural and solid mechanics simulation, in ACM/IEEE Proceedings of SC02: High Performance Networking and Computing. Gordon Bell Award.

Digital Library

[24]

{24} J. MANDEL, M. BREZINA, AND P. VANEK, Energy optimization of algebraic multigrid bases, Tech. Report 125, UCD/CCM, February 1998.

[25]

{25} G. L. NIEBUR, M. J. FELDSTEIN, AND T. M. KEAVENY, Biaxial failure behavior of bovine tibial trabecular bone, Journal of Biomechanical Engineering, 124 (2002), pp. 699-705.

[26]

{26} G. L. NIEBUR, M. J. FELDSTEIN, J. C. YUEN, T. J. CHEN, AND T. M. KEAVENY, High-resolution finite element models with tissue strength asymmetry accurately predict failure of trabecular bone, Journal of Biomechanics, 33 (2000), pp. 1575-1583.

[27]

{27} G. L. NIEBUR, J. C. YUEN, A. C. HSIA, AND T. M. KEAVENY, Convergence behavior of high-resolution finite element models of trabecular bone, Journal of Biomechanical Engineering, 121 (1999), pp. 629-635.

[28]

{28} P. PAPADOPOULOS AND J. LU, A general framework for the numerical solution of problems in finite elasto-plasticity, Computer Methods in Applied Mechanics and Engineering, 159 (1998), pp. 1-18.

[29]

{29} G. POOLE, L. Y.C., AND M. J., Advancing analysis capabilities in ansys through solver technology, Electronic Transactions in Numerical Analysis, 15 (2003), pp. 106-121.

[30]

{30} Prometheus. www.cs.berkeley.edu/~madams.

[31]

{31} P. RÜEGSEGGER, B. KOLLER, AND R. MÜLLER, A microtomographic system for the nondestructive evaluation of bone architecture, Calcified Tissue International, 58 (1996), pp. 24-29.

[32]

{32} B. SMITH, P. BJORSTAD, AND W. GROPP, Domain Decomposition, Cambridge University Press, 1996.

Digital Library

[33]

{33} M. M. STROUT, L. CARTER, J. FERRANTE, J. FREEMAN, AND B. KREASECK, Combining performance aspects of irregular Gauss-Seidel via sparse tiling, in 15th Workshop on Languages and Compilers for Parallel Computing (LCPC), College Park, Maryland, 2002.

Digital Library

[34]

{34} U. TROTTENBERG, C. OOSTERLEE, AND A. SCHÜLLER, Multigrid, Academic Press, London, 2001.

Digital Library

[35]

{35} R. TUMINARO AND C. TONG, Parallel smoothed aggregation multigrid: Aggregation strategies on massively parallel machines , in SuperComputing 2000 Proceedings, J. Donnelley, ed., 2000.

Digital Library

[36]

{36} D. ULRICH, B. VAN RIETBERGEN, A. LAIB, AND P. RÜEGSEGGER, The ability of three-dimensional structural indices to reflect mechanical aspects of trabecular bone., Bone, 25 (1999), pp. 55-60.

[37]

{37} D. ULRICH, B. VAN RIETBERGEN, H. WEINANS, AND P. RUEGSEGGER, Finite element analysis of trabecular bone structure: a comparison of image-based meshing techniques, Journal of Biomechanics, 31 (1998), pp. 1187-1192.

[38]

{38} B. VAN RIETBERGEN, R. HUISKES, F. ECKSTIEN, AND P. RÜEGSEGGER, Trabecular bone tissue strains in the healthy and osteoporotic human femur, Journal of Bone and Mineral Research, (2003). In press.

[39]

{39} B. VAN RIETBERGEN, H. WEINANS, R. HUISKES, AND A. ODGAARD, A new method to determine trabecular bone elastic properties and loading using micromechanical finite element models, Journal of Biomechanics, 28 (1995), pp. 69-81.

[40]

{40} P. VANEK, J. MANDEL, AND M. BREZINA, Algebraic multigrid by smoothed aggregation for second and fourth order elliptic problems, in 7th Copper Mountain Conference on Multigrid Methods, 1995.

[41]

{41} P. VANEk, J. MANDEL, AND M. BREZINA, Convergence of algebraic multigrid based on smoothed aggregation, Numerische Mathematik, 88 (2001), pp. 559-579.

[42]

{42} W. L. WAN, An energy minimizing interpolation for multigrid methods, Tech. Report 97-18, UCLA, April 1997. Department of Mathematics.

Cited By

Emerzian SWu TVaidya RTang SAbergel RKeaveny T(2023)Relative Effects of Radiation‐Induced Changes in Bone Mass, Structure, and Tissue Material on Vertebral Strength in a Rat ModelJournal of Bone and Mineral Research10.1002/jbmr.482838:7(1032-1042)Online publication date: 4-Jun-2023
https://doi.org/10.1002/jbmr.4828
Sadoughi SBevill GMorgan EPalepu VKeaveny TWear K(2022)Biomechanical structure–function relations for human trabecular bone — comparison of calcaneus, femoral neck, greater trochanter, proximal tibia, and vertebraComputer Methods in Biomechanics and Biomedical Engineering10.1080/10255842.2022.206946526:5(508-516)Online publication date: 17-May-2022
https://doi.org/10.1080/10255842.2022.2069465
Xu XYue XMao RDeng YHuang SZou HLiu XHu SFeng CShu SMo Z(2022)JXPAMG: a parallel algebraic multigrid solver for extreme-scale numerical simulationsCCF Transactions on High Performance Computing10.1007/s42514-022-00125-95:1(72-83)Online publication date: 25-Oct-2022
https://doi.org/10.1007/s42514-022-00125-9
Show More Cited By

Recommendations

Algebraic multigrid for higher-order finite elements

Two related approaches for solving linear systems that arise from a higher-order finite element discretization of elliptic partial differential equations are described. The first approach explores direct application of an algebraic-based multigrid ...
Multigrid for the Mortar Finite Element Method

A multigrid technique for uniformly preconditioning linear systems arising from a mortar finite element discretization of second order elliptic boundary value problems is described and analyzed. These problems are posed on domains partitioned into ...
Algebraic Multigrid for Moderate Order Finite Elements

We investigate the use of algebraic multigrid (AMG) methods for the solution of large sparse linear systems arising from the discretization of scalar elliptic partial differential equations with Lagrangian finite elements of order at most 4. The resulting ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing

November 2003

859 pages

ISBN:1581136951

DOI:10.1145/1048935

General Chair:
James R. McGraw

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SC '03

Sponsor:

SIGARCH
IEEE-CS

SC '03: International Conference for High Performance Computing, Networking, Storage and Analysis

November 15 - 21, 2003

AZ, Phoenix, USA

Acceptance Rates

SC '03 Paper Acceptance Rate 60 of 207 submissions, 29%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
335
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Emerzian SWu TVaidya RTang SAbergel RKeaveny T(2023)Relative Effects of Radiation‐Induced Changes in Bone Mass, Structure, and Tissue Material on Vertebral Strength in a Rat ModelJournal of Bone and Mineral Research10.1002/jbmr.482838:7(1032-1042)Online publication date: 4-Jun-2023
https://doi.org/10.1002/jbmr.4828
Sadoughi SBevill GMorgan EPalepu VKeaveny TWear K(2022)Biomechanical structure–function relations for human trabecular bone — comparison of calcaneus, femoral neck, greater trochanter, proximal tibia, and vertebraComputer Methods in Biomechanics and Biomedical Engineering10.1080/10255842.2022.206946526:5(508-516)Online publication date: 17-May-2022
https://doi.org/10.1080/10255842.2022.2069465
Xu XYue XMao RDeng YHuang SZou HLiu XHu SFeng CShu SMo Z(2022)JXPAMG: a parallel algebraic multigrid solver for extreme-scale numerical simulationsCCF Transactions on High Performance Computing10.1007/s42514-022-00125-95:1(72-83)Online publication date: 25-Oct-2022
https://doi.org/10.1007/s42514-022-00125-9
Boffy HVenner C(2014)Multigrid solution of the 3D stress field in strongly heterogeneous materialsTribology International10.1016/j.triboint.2014.02.01974(121-129)Online publication date: Jun-2014
https://doi.org/10.1016/j.triboint.2014.02.019
Coelho PCardoso JFernandes PRodrigues H(2011)Parallel computing techniques applied to the simultaneous design of structure and materialAdvances in Engineering Software10.1016/j.advengsoft.2010.10.00342:5(219-227)Online publication date: 1-May-2011
https://dl.acm.org/doi/10.1016/j.advengsoft.2010.10.003
Eswaran SBayraktar HAdams MGupta AHoffmann PLee DPapadopoulos PKeaveny T(2007)The micro-mechanics of cortical shell removal in the human vertebral bodyComputer Methods in Applied Mechanics and Engineering10.1016/j.cma.2006.06.017196:31-32(3025-3032)Online publication date: Jun-2007
https://doi.org/10.1016/j.cma.2006.06.017
Nakajima K(2006)The impact of parallel programming models on the performance of iterative linear solvers for finite element applicationsProceedings of the 7th international conference on High performance computing for computational science10.5555/1761728.1761757(334-348)Online publication date: 10-Jun-2006
https://dl.acm.org/doi/10.5555/1761728.1761757
Sbalzarini IWalther JBergdorf MHieber SKotsalis EKoumoutsakos P(2006)PPMJournal of Computational Physics10.1016/j.jcp.2005.11.017215:2(566-588)Online publication date: 1-Jul-2006
https://dl.acm.org/doi/10.1016/j.jcp.2005.11.017
Nakajima K(2005)Parallel programming models for finite-element method using preconditioned iterative solvers with multicolor ordering on various types of SMP cluster supercomputersProceedings of the Eighth International Conference on High-Performance Computing in Asia-Pacific Region10.1109/HPCASIA.2005.71Online publication date: 30-Nov-2005
https://dl.acm.org/doi/10.1109/HPCASIA.2005.71
Adams MBayraktar HKeaveny TPapadopoulos PHuskamp J(2004)Ultrascalable Implicit Finite Element Analyses in Solid Mechanics with over a Half a Billion Degrees of FreedomProceedings of the 2004 ACM/IEEE conference on Supercomputing10.1109/SC.2004.62Online publication date: 6-Nov-2004
https://dl.acm.org/doi/10.1109/SC.2004.62

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents