Mix together water and milk in a large saucepan; bring to a boil.

Add tea bags and remove from heat. Let steep for 15 minutes.

Stir in honey, mixing well to dissolve; mix in vanilla extract.

Pour into cups and serve warm or chill and serve cold.