We present a generic theory for the dynamics of a stiff filament under tension, in an active medium with orientational correlations, such as a microtubule in contractile actin. In sharp contrast to the case of a passive medium, we find the filament can stiffen, and possibly oscillate or buckle, depending on both the contractile or tensile nature of the activity and the filament-medium anchoring interaction. We also demonstrate a strong violation of the fluctuation-dissipation (FD) relation in the effective dynamics of the filament, including a negative FD ratio. Our approach is also of relevance to the dynamics of axons, and our model equations bear a remarkable formal similarity to those in recent work [Martin P, Hudspeth AJ, Juelicher F (2001) Proc Natl Acad Sci USA 98: 14380-14385] on auditory hair cells. Detailed tests of our predictions can be made by using a single filament in actomyosin extracts or bacterial suspensions.