One occasionally hears that sentences should not begin with with. There have been many attempts to categorize many words in English as improper to place at the beginning of a sentence. These "rules" are simply a matter of individual preference, not of grammatical correctness. You may begin a sentence with with.