Can I drink coffee/tea or will the caffeine dehydrate me?

Yes. Both can even count towards your daily fluid goal, just remember to also consistently drink other fluids throughout the day. Caffeine is a mild diuretic, but if you drink a good amount of fluids (nothing crazy extra) over a 24-hour period, its effect on your total hydration are negligible.