If a one-tailed z-test uses a 5% significance level, the test will reject a:

A true null hypothesis 5% of the time.

explanation

The level of significance is the probability of rejecting the null hypothesis when it is true. The probability of rejecting the null when it is false is the power of a test.