Should I get rid of craftbukkit and keep spigot?

This does depend on preference, however using PaperSpigot rather then CraftBukkit has many advantages, like speed and a larger percentage of the plugin library is updated.

it all depends on personal preference. If you want a more vanilla experience, like a survival server, then craftbukkit would be the way to go. Although if you want a fancy server like Hypixel, for example, then I would suggest going with spigot.