What is the most efficient and affordable way to heat a home?

I have a 2300 square foot home in Knightdale, NC. It comes with a heat pump heating system and a propane fireplace. Should I use the heat pump or the propane fireplace or should I use a portable kerosene space heater. What is cheaper?