The third floor in our house still had the original gas light fixtures that were still active! We had a plumber out to do some miscellaneous things and we asked him to cap off the gas line. Sadly that meant removing the fixtures. I think we'll just glue them onto to the cap, I don't want to get rid of them.
But thankfully the kids will no longer be tempted to open the gas line.