Degradation of material properties by high-pressure hydrogen is an important factor in determining the safety and reliability of materials used in high-pressure hydrogen storage and delivery. Hydrogen damage mechanisms have a time dependence that is linked to hydrogen outgassing after exposure to the hydrogen atmosphere that makes ex situ measurements of mechanical properties problematic. Designing in situ measurement instruments for high-pressure hydrogen is challenging due to known hydrogen incompatibility with many metals and standard high-power motor materials such as Nd. Here we detail the design and operation of a solenoid based in situ tensile tester under high-pressure hydrogen environments up to 42 MPa (6000 psi). Modulus data from high-density polyethylene samples tested under high-pressure hydrogen at 35 MPa (5000 psi) are also reported as compared to baseline measurements taken in air.