Do I need to manually enter the Xero invoice amount?

The amount to be paid will be fetched automatically from your invoice in Xero. You are free to modify the amount invoiced, depending on your contract terms.