Sure, but either rotate your crops to provide the used nitrogen or refresh soil with compost... Simply planting nitrogen fixing plants during off season is a wonderful help to soil. Vetch, wild sweet peas, winter wheat & clover are all wonderful & can be later tilled into ground to feed future plants.
Hope that helps.