Best and Worst Flowers for People With Allergies Worst Plants for Allergies You can expect more plant pollen and seasonal allergies if you put any of these plants in your yard. Flowers/herbs Amaranth (pigweed), chamomile, chrysanthemums, daisies, goldenrod, ordinary sunflowers. Shrubs/vines Cypress, jasmine vine, juniper, wisteria. Trees Alder, ash (male), aspen (male), beech, birch, box elder (male), cedar (male),