That one remark completely ruined the fun atmosphere.
Very often used with せっかく (with effort, specially) to express frustration that something done with care or effort has been wasted. Common patterns: 〜が台無しになる (something gets ruined) and 〜を台無しにする (to ruin something).