It depends on the database server software and the type of table / index you are using. Inserts will be slower anytime you have indexes of any type, but not necessarily a lot - it will also depend on the size of the table.
In general, unique indexes should speed up any SELECT queries you use that can use index (s)