HTTP Error 500 in query_adsabs: HTTP/2 500

[maximmasiutin]

I am getting HTTP Error 500 in query_adsabs: HTTP/2 500 on certain pages

This can be reproduced on page 11β-Hydroxyprogesterone with --slow command line option.

Maybe it was caused by the changes that I introduced which were related to POST->GET changes?

>Remedial work to prepare citations
[09:54:34] Processing page 11β-Hydroxyprogesterone...

[...]

 >Expanding from BibCodes via AdsAbs API
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Using Zotero translation server to retrieve details from URLs.
   >Retrieved info from http://www.hmdb.ca/metabolites/HMDB04031

>Expand individual templates by API calls
 >Checking CrossRef database for doi.
 >Searching PubMed...
 >Checking AdsAbs database
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Searching PubMed...
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500
 >Checking AdsAbs database
   !HTTP Error 500 in query_adsabs: HTTP/2 500

[GlazerMann]

I saw that too. No idea.

[maximmasiutin]

Maybe you could add debugging output for this error, i.e. when this error happens, it saves request and response data. You can add an environment variable to have this output configurable. I will run this on 11β-Hydroxyprogesterone and you will be able to see what's wrong.

[GlazerMann]

Internal Server Error

The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.

https://api.adsabs.harvard.edu/v1/search/bigquery?q=*:*&fl=arxiv_class,author,bibcode,doi,doctype,identifier,issue,page,pub,pubdate,title,volume,year&rows=2000

HTTP/2 500
date: Fri, 12 Apr 2024 13:13:31 GMT
content-type: text/html
content-length: 290

[maximmasiutin]

Can you please also give the headers and the body of the request? This line was made by the following code:

    $big_query_opts=[
	      CURLOPT_HTTPHEADER => ['Content-Type: big-query/csv', 'Authorization: Bearer ' . PHP_ADSABSAPIKEY],
	      CURLOPT_CUSTOMREQUEST => 'POST',
	      CURLOPT_POSTFIELDS => "$identifier\n" . implode("\n", $ids)];
    $curl_opts += $big_query_opts;
    unset($big_query_opts);

but we don't see the CURLOPT_POSTFIELDS and CURLOPT_HTTPHEADER (redact the Bearer to not expose the PHP_ADSABSAPIKEY)

[GlazerMann]

https://en.wikipedia.org/w/index.php?title=User%3AAManWithNoPlan%2Fsandbox3&diff=1218584473&oldid=1218584449 works when not page of larger page. Weird

[GlazerMann]

Nothing in the error messages of value

[maximmasiutin]

Nothing in the error messages of value

Let me postpone the proposal of the implementation of the GET to POST for a while, see the comment #4480 (comment)