The verb "insist" is followed by the preposition "on", and when followed by another verb, it takes the -ing form (e.g., going). "With them" correctly indicates companionship.
He insisted __ going _____ them.
Review the verified answer and explanation for this FBR - Federal Board of Revenue past-paper question on CampusFin.