ipUdZddlZddlZddlZddlmZmZmZddl Z ddl Z ddl m Z ddl mZddlmZddlmZmZmZmZej,r ddlmZdd lmZd d d d d ddZeeej<fed<ddgZ dZ!ddddZ"ee#efed< dZ$ dedzdeeefdzfdZ%dddedzddfdZ&d eddddfd!Z'd"d#de(eeej<ffd$Z)d%eddfd&Z*y)'a9This is the implementation of the Bing-Web engine. Some of this implementations are shared by other engines: - :ref:`bing images engine` - :ref:`bing news engine` - :ref:`bing videos engine` .. note:: Some functionality (paging and time-range results) are not supported since they depend on JavaScript. N)parse_qs urlencodeurlparse)html) EngineTraits) region_tag) eval_xpatheval_xpath_getindexeval_xpath_list extract_text) SXNG_Response) OnlineParamszhttps://www.bing.comQ182496z*https://github.com/MicrosoftDocs/bing-docsFHTML)website wikidata_idofficial_api_documentationuse_official_apirequire_api_keyresultsaboutgeneralwebToffmoderatestrict)r_safesearch_mapzhttps://www.bing.com/search engine_regionreturnc|r|dk(ryd|iS)aAPI documentation states the ``mkt`` parameter is *the recommended primary signal* for locale: If known, you are encouraged to always specify the market. Specifying the market helps Bing route the request and return an appropriate and optimal response. The ``mkt`` parameter takes a full ``-`` code. This function is shared with :py:mod:`searx.engines.bing_images`, :py:mod:`searx.engines.bing_news`, and :py:mod:`searx.engines.bing_videos`. clearNmkt)r s #/root/searxng/searx/engines/bing.pyget_locale_paramsr'7s MW4 = !!paramsrcX|r|dk(ry|jdd}|d|d|dd<y) aOverride the ``Accept-Language`` header. The default header built by :py:class:`~searx.search.processors.online.OnlineProcessor` appends ``en;q=0.3`` as a fallback language:: Accept-Language: de,de-DE;q=0.7,en;q=0.3 Bing seems to better select the results locale based on the ``Accept-Language`` value header. This function is shared with :py:mod:`searx.engines.bing_images`, :py:mod:`searx.engines.bing_news`, and :py:mod:`searx.engines.bing_videos`. r#N-r,z;q=0.9headersAccept-Language)split)r)r langs r&override_accept_languager1KsC MW4   s #A &D.;_AdV6+JF9'(r(queryc2tj|dtj}t|||tj |j dddd}t |}|r|j|tdt||d<d|d <|S) zAssemble a Bing-Web request.searxng_locale safesearchrr)qadlt?urlTallow_redirects) traits get_region all_localer1rgetr'updatebase_urlr)r2r)r query_params locale_paramss r&requestrCas%%f-=&>@Q@QRMV]3##FJJ|Q$?G*L &m4MM*j)L"9!:;F5M!%F  Mr(respr cg}tj|j}t|dD]@}t |ddd}||j j dd}t|}|r|sA|jdrtt|j}|j d}|rV|d} | jd r@| d d} | d t|  d zzz } tj| jd d}t!|d} | D]7} | j#dD]!} | j%j'| #9t| }|j)|||dC|rPdj+t!|d}t-j.dd|}|r|j)dt1|i|S)zGet response from Bing-Webz4//ol[@id="b_results"]/li[contains(@class, "b_algo")]z.//h2/arNhrefzhttps://www.bing.com/ck/a?ua1r=zutf-8replace)errorsz.//pz.//span[@class="algoSlug_icon"])r9titlecontentz!//span[@class="sb_count"]//text()z[^0-9]number_of_results)r fromstringtextr r attribr>r startswithrrr2lenbase64urlsafe_b64decodedecoder xpath getparentremoveappendjoinresubint)rDrdomitemlinkrFrNqsu_valuesu_valencoded content_elspiconrOresult_len_containers r&responserlzs')G //$)) $C%[\J"4At< < {{vr*T"5  ??7 8(4.../Bvvc{H  ##D)#ABiGss7|ma&788G!33G<CCGT]C^D!v.  .A AB . ''- . .{+teHI?JB!wwz#7Z'[\!vvi5IJ  NN/5I1JK L Nr( engine_traitsc *ddlm}ddlm}|dddddddd }|d |d }|js t d t j|j}ddi}t|dD] }tt|jdd}|dk(r||_ 5tjj!|dD]} | j#dd} | d|} |j| | } t%tj&j)| d|j+} |j.j| } | r| | k7rt1d| d| d| | |j.| < y#tj,$rYwxYw)zFetch regions from Bing-Web.r)r>) gen_useragentzJtext/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8zen-US;q=0.5,en;q=0.31z keep-alivez max-age=0)z User-AgentAcceptr.DNT ConnectionzUpgrade-Insecure-RequestszSec-GPCz Cache-Controlz$https://www.bing.com/account/general)r-timeoutzResponse from Bing is not OK.zzh-hkzen-hkzE//div[@id="region-section-content"]//div[@class="regionItem"]/a/@hrefccr#T)de_facto_r+zCONFLICT: babel z --> z, N) searx.networkr> searx.utilsrook RuntimeErrorrrQrRr rrr2r=babel languagesget_official_languagesr/rLocaleparseupperUnknownLocaleErrorregionsprint) rmr>ror-rDramap_market_codesrFcc_taglang_tag market_codesxng_tagconflicts r& fetch_traitsrs")$o^1"%($ G 5wPQ RD 77:;; //$)) $C (3 gh:(4.../5a8 W '-M $ >>vPT>U :H~~c*1-H%Jax0K*..{KHK %ell&8&8Hflln9]&^_ %,,00:H{*XxQ\]^.9M ! !( +# ::++  s5;E<<FF)+__doc__rVr^typingt urllib.parserrrr}babel.languageslxmlrsearx.enginelib.traitsr searx.localesrrzr r r r TYPE_CHECKINGsearx.extended_typesr searx.search.processorsrrdictstrAny__annotations__ categoriesr5rr`r@r'r1rClistrlrr%r(r&rsC  66 /$VV??24&"N tCJ    #c3h 6 ("S4Z"DcNT4I"(K^KC$JKSWK,3>2.?.tDaee,<'=.b4: 4:4:r(