Even if you don’t have outdoor gardening space, there are plenty of herbs that you can grow indoors successfully on a sunny windowsill. If you do grow herbs in your garden, fall is a great time to think about starting an indoor windowsill herb garden to grow herbs indoors so you can enjoy their fresh flavor all winter long.: