Short answer
No, it's not safe, especially for a small cat. Horseradish is pungent and irritating, and a tiny pet's smaller body is more sensitive to the stomach upset it can cause. Keep it away, and if your kitten ate any, watch for drooling or vomiting and call your vet if those signs appear.
Horseradish — Food safety facts
Feed with care · Cats · full breakdown on the linked food page
Pungent and irritating to the mouth and stomach. Avoid.
The full verdict, portion guidance and serving notes are collected on the Horseradish food facts page.