Unlike other gases, hydrogen can promote embrittlement of structural metals at ambient temperature. The effects of high-pressure hydrogen gas on structural metals vary significantly depending on material, environmental, and mechanical variables as well as the metric used to evaluate performance. In this short review, we provide basic guidance on selection of materials for hydrogen gas service emphasizing the need for performing tests in relevant environments and using appropriate methods. Fracture mechanics and fitness-for-service type design approaches are highly recommended for ensuring robust yet efficient high-pressure designs for hydrogen gas service.