Export to Excel option of qListView exports to Excel all fields that you specify in the Display Fields property.
To achieve your goal use the qListView with a qExcelViewer web part.
In this way you can display your 5 fields in a qListView and export to Excel only 4 fields.
These are the steps to follow:
– on the qListView please specify the Search Session Name and Excel Viewer Url (provide the url that you create in the next step)
– create a page and drop a qExcelViewer on it, then open ezEdit and specify the same name you used for the SearchSessionName above then select the fields you want to display
Please let me know if you have any question and also check the documentation for more details.