In windows, you can just open a notepad > paste your key there > Save as '.key' file instead of ".txt" file. Then just upload that to your S3 and follow the remaining steps.

Hope this helps!!