Can my customers use the debit cards for e-commerce transactions?

Yes.

The debit cards can be used for card present (in-store) and card not present (e-commerce) transactions anywhere Mastercard is accepted.