Instructions
In a WIKI page, only Display and Edit forms are available to Nintex Forms. New Items can't be edited from here. SharePoint Designer has this limitation as well.
Additional Information
The dialog cannot be changed for an individual library. It's the default new page dialog for the whole site collection.
Related Links