1. A defect detection system for computerized detection of defects in an inspected object based on processing of an inspection image generated by collecting signals arriving from the inspected object, the system comprising: an interface for obtaining an inspected noise-indicative value and multiple reference noise-indicative values, the inspected noise-indicative value representative of an analyzed pixel and each of the reference noise-indicative values representative of a reference pixel among a plurality of reference pixels; and a processor, comprising: a noise analysis module, configured to compute a representative noise-indicative value based on a plurality of noise-indicative values which comprises the inspected noise-indicative value and the multiple reference noise-indicative values; and a defect analysis module, configured to calculate a defect-indicative value based on an inspected value representative of the analyzed pixel, and to determine a presence of a defect in the analyzed pixel based on the representative noise-indicative value and the defect-indicative value.