Start by adding the vinegar, sugar, salt, and water to a sauce pan. Bring to a boil, then remove from the stove, and let the pickling liquid cool. As it cools, toss in the dill, garlic, and banana peppers.
To a large mason jar, add in the halved kirby pickles. pour in all of the pickling mixture to cover the pickles, and cover with the lid.
Let these sit for a couple of days to let all of the flavors meld, then dig into them as you would any other pickle.