people use this when they want to say something bad about somebody yet they feel they respect the person. so to not annoy the person too much, they start with "with all due respect".
people use this when they want to say something bad about somebody yet they feel they respect the person. so to not annoy the person too much, they start with "with all due respect".