My app didn't pass moderation for the App Store. Can I disable using IDFA and AdSupport when using AppMetrica?

You can't disable using the IDFA. If you aren't able to pass App Store moderation, when publishing the app, you should make the following changes: in the Advertising Identifier section enable the option Attribute this installation to a previously served advertisement.