You should be able to use the HTML5 video tag: http://www.w3schools.com/html/html5_video.asp

Or you could look for a plugin but as you know, I’d recommend keeping plugins to a minimum. 🙂