i] jdZddlZddlmZddlmZddlmZddlZddl m Z m Z m Z m Z mZddlmZmZddlmZdd lmZmZdd lmZej0r dd lmZdd lmZd ddddddZddgZdZdZ dZ!dZ"dZ#de$ddddfdZ%dddefdZ&ddde'e$e(ffdZ)d efd!Z*d"e$dzde+e,e$e$e$edzffd#Z-y)$a:Google Scholar is a freely accessible web search engine that indexes the full text or metadata of scholarly literature across an array of publishing formats and disciplines. Compared to other Google services the Scholar engine has a simple GET REST-API and there does not exists ``async`` API. Even though the API slightly vintage we can make use of the :ref:`google API` to assemble the arguments of the GET request. Configuration ============= .. code:: yaml - name: google scholar engine: google_scholar shortcut: gos Implementations =============== N) urlencode)datetime)html) eval_xpatheval_xpath_getindexeval_xpath_list extract_text ElementType)SearxEngineCaptchaException SearxEngineAccessDeniedException) fetch_traits)get_google_infotime_range_dict) EngineResults) SXNG_Response) OnlineParamszhttps://scholar.google.comQ494817z+https://developers.google.com/custom-searchFHTML)website wikidata_idofficial_api_documentationuse_official_apirequire_api_keyresultssciencezscientific publicationsT2queryparamsrreturnc*t|t}|djdd|d<d|i|d|ddz dzd d d }|jt |d |dzd zt |z|d<|d|d<|dj|dy)zGoogle-Scholar search request subdomainzwww.zscholar.qrpageno 20070)startas_sdtas_viszhttps://z /scholar?urlcookiesheadersN)rtraitsreplaceupdatetime_range_argsr)rr google_infoargss -/root/searxng/searx/engines/google_scholar.pyrequestr5Ls"&&1K*;7?? SK  U  h  "Q&",  D KK'([!99KG)TX/YF5M#I.F9 9[34resprc|jdvrbd|jvrTd|jdvr tdtjd|jdj ddt }tj|j}t|t|d D]}tt|d }|stt|d xsd }|r|d dj}t|dd}tt|dxsd }t!tt|d\}} } } | |vrd } tt|dxsd } d } d }t|ddd}tt|d }|dk(r|}n|} |j#|j$j'||||| | | || | | t|dD]6}|j#|j$j)t|8t|dD]6}|j#|j$j)t|8|S)z"Parse response from Google Scholar)i-i.i/i3i4Locationz/sorry/index?continuez(google_scholar: unusual traffic detectedmessagez location ?rz//div[@data-rp]z .//h3[1]//az.//span[@class='gs_ctg2']r$z.//h3[1]//a/@hrefz.//div[@class='gs_rs']z.//div[@class='gs_a']z>.//div[@class='gs_fl']/a[starts-with(@href,'/scholar?cites=')]z#.//div[@class='gs_or_ggsm']/a/@hrefN)defaultz[PDF]) typer+titleauthors publisherjournal publishedDatecontentcommentshtml_urlpdf_urlz2//div[contains(@class, 'gs_qsuggest_wrap')]//li//a) suggestionz//div[@class='gs_r gs_pda']/a) correction) status_coder-r httpxTooManyRedirectssplitrr fromstringtextdetect_google_captcharr rlowerr parse_gs_aaddtypesPaper LegacyResult)r7resdomresultrApub_typer+rFrBrDrCrErGrHrIdoc_urldoc_typerJrKs r4responser_asu 44t||9S "dll:&> >3B $$yj1I1O1OPS1TUV1W0X%YZZ /C //$)) $C#"#'890 Z >? $Z8S%TU[Y[ "~++-H&v/BAF#Jv7O$PQWUW5? F,CD E6 2)]  I F,lm n trt  %f.SUV`de 63N OP w GH  IIOO#+!!   E0 f!&Z[M   &&,z2J&KLM!&EFM   &&,z2J&KLM Jr6chi}|dtvr$tjjdz |d<|S)aReturns a dictionary with a time range arguments based on ``params["time_range"]``. Google Scholar supports a detailed search by year. Searching by *last month* or *last week* (as offered by SearXNG) is uncommon for scientific publications and is not supported by Google Scholar. To limit the result list when the users selects a range, all the SearXNG ranges (*day*, *week*, *month*, *year*) are mapped to *year*. If no range is set an empty dictionary of arguments is returned. Example; when user selects a time range and we find ourselves in the year 2025 (current year minus one): .. code:: python { "as_ylo" : 2024 } time_ranger$as_ylo)rrnowyear)rret_vals r4r1r1s6(!G l.$LLN//!3 Nr6rZc4t|dr tdy)z{In case of CAPTCHA Google Scholar open its own *not a Robot* dialog and is not redirected to ``sorry.google.com``. z//form[@id='gs_captcha_f']zCAPTCHA (gs_captcha_f)r:N)rr )rZs r4rRrRs #34)2JKK5r6rQc||dk(rgdddfS|jd}|djd}|d}t|dk7r|d|dfS|djd}t|dkDrdj|dd}|d k(rd}nd}|d} tj|j d }||||fS#t $rd}YwxYw) zParse the text written in green. Possible formats: * "{authors} - {journal}, {year} - {publisher}" * "{authors} - {year} - {publisher}" * "{authors} - {publisher}" Nr=z - rz, r>r$u…z%Y)rOlenjoinrstrptimestrip ValueError)rQs_textrBrC journal_yearrDrdrEs r4rTrTs |trz2r4 ZZ F.GBZI 6{aIt++!9??4(L <1yya!34 e G  D ))$**,=  GY 55  s$B<< C  C ).__doc__typingt urllib.parserrlxmlrrM searx.utilsrrrr r searx.exceptionsr r searx.engines.googler rrsearx.result_typesr TYPE_CHECKINGsearx.extended_typesrsearx.search.processorsrabout categoriespagingmax_pagelanguage_supporttime_range_support safesearchstrr5r_dictintr1rRtuplelistrTr6r4rs." [- -??24,"O  2 3    535545*I?I}IXNtCH~4L{L!6S4Z!6E$s)S#x$*N$O!6r6