POST returning 404

[cpm18]

I have a simple POST request that I am trying to make, but it seems to constantly fail in Vortex. I am able to get a response just fine using both cURL and Postman, so I don't believe it is an issue of server-side blocking.

Sample Vortex code is listed below

Code: Select all

		<urlcp header "Host" "www.amazon.com">
		<urlcp header "Accept" "text/html,*/*">
		<urlcp header "Accept-Language" "en-US,en;q=0.5">
		<urlcp header "Accept-Encoding" "gzip, deflate, br">
		<urlcp header "Origin" 'https://www.amazon.com'>
		<urlcp header "Connection" "keep-alive">
		<urlcp header "Referer" https://www.amazon.com/gp/product/B0D5JLH3RJ>
		<urlcp header "Sec-Fetch-Dest" "empty">
		<urlcp header "Sec-Fetch-Mode" "cors">
		<urlcp header "Sec-Fetch-Site" "same-origin">
		<urlcp header "TE" "trailers">
		<urlcp header "Content-Type" "application/x-www-form-urlencoded;charset=UTF-8">
		<urlcp header "X-Requested-With" "XMLHttpRequest">
		<$submiturl='https://www.amazon.com/hz/reviews-render/ajax/medley-filtered-reviews/get/ref=cm_cr_dp_d_fltrs_srt'>
		<$submitdata='language=en_US&asin=B0D5JLH3RJ&sortBy=recent&scope=reviewsAjax1'>
		<urlcp useragent "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0">
		<submit URL=$submiturl method=POST DATA=$submitdata CONTENT-TYPE='application/x-www-form-urlencoded;charset=UTF-8'>

cURL request is also listed, which consistently gets a proper response.

Code: Select all

curl 'https://www.amazon.com/hz/reviews-render/ajax/medley-filtered-reviews/get/ref=cm_cr_dp_d_fltrs_srt' --compressed -X POST -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0' -H 'Accept: text/html,*/*' -H 'Accept-Language: en-US,en;q=0.5' -H 'Accept-Encoding: gzip, deflate, br' -H 'X-Requested-With: XMLHttpRequest' -H 'Content-Type: application/x-www-form-urlencoded;charset=UTF-8' -H 'Origin: https://www.amazon.com' -H 'Connection: keep-alive' -H 'Referer: https://www.amazon.com/gp/product/B0D5JLH3RJ' -H 'Sec-Fetch-Dest: empty' -H 'Sec-Fetch-Mode: cors' -H 'Sec-Fetch-Site: same-origin' -H 'TE: trailers' --data-raw 'language=en_US&asin=B0D5JLH3RJ&sortBy=recent&scope=reviewsAjax1'

I am using Commercial Version 7.07.1591132145 20200602 (x86_64-unknown-winnt-64-64). Is there possibly some low level handshaking that is failing with this older Vortex version when communicating with this server?

[John]

It's possible if there is a mismatch in supported SSL protocols or ciphers.

What error do you get? It should be in vortex.log, or output as comments.

[cpm18]

There are no errors in vortex.log. The site simply responds with a 404 errors page.

My initial thought was my POST request is not correct, but I have gone over it a number of times and am fairly sure it is fine. I have a 3rd party tool which I can access which takes my simple request and simulates the handshaking done in a browser. When using that service, I get the proper response. So I am fairly confident the issue isn't with the POST request being incorrect, which is why I was looking into other issues, such as the vortex engine being too outdated for this server. But I don't know how to detect whether that is the case here.

[John]

You could use <urlinfo> with various options to see what headers or other information is returned.

You may also want to use <urlcp sslprotocols> to restrict it to TLSv1.2, which I think is the most recent one your version supports.

There are also trace options https://docs.thunderstone.com/site/vort ... trace.html that you can use to add more verbosity in case there are other returns coming through.