In a medium mixing bowl, combine the creamy peanut butter, softened butter, powdered sugar, and alcohol-free vanilla extract. Use a hand mixer or a sturdy spatula to cream these ingredients together until the mixture is smooth and slightly fluffy.
Lay out half of the Ritz crackers on a large baking sheet lined with parchment paper, bottom side up. Place about a tablespoon of the peanut butter mixture onto the center of each cracker. Top each one with another cracker, pressing down gently until the filling reaches the edges.
In a microwave safe bowl, combine the semi sweet chocolate chips and the coconut oil. Heat in 30 second intervals, stirring well between each session, until the chocolate is completely smooth and glossy.
Using a fork or a specialized dipping tool, submerge one cracker sandwich at a time into the melted chocolate. Lift the treat out and tap the fork gently against the side of the bowl to let any excess chocolate drip off. Carefully slide the chocolate covered cracker back onto the parchment paper.
While the chocolate is still wet, immediately top each treat with red and green sprinkles or a tiny pinch of sea salt for a festive touch. Once all the crackers are dipped, place the baking sheet in the refrigerator for at least 30 minutes.