i dZddlZddlmZmZddlmZddlZddlmZddl m Z ddl m Z ddl mZdd lmZmZd d d d dddZdgZd ZdZ d Ze e de de ddZd ZddddZdZdZdZde fdZy) zPeertube and :py:obj:`SepiaSearch ` do share (more or less) the same REST API and the schema of the JSON result is identical. N)datetime timedelta) urlencode)parse) relativedelta) EngineTraits) language_tag) html_to_texthumanize_numberzhttps://joinpeertube.org Q50938515zWhttps://docs.joinpeertube.org/api-rest-reference.html#tag/Search/operation/searchVideosTFJSON)website wikidata_idofficial_api_documentationuse_official_apirequire_api_keyresultsvideoszhttps://peer.tube)weeks)months)years)dayweekmonthyearbothfalse)rc |sytj|dd}tjddzt |dd|dd z d zd d t |d d z|d<| |dxxd|zz cc<|dxxd|zz cc<|dt vrMtjjt |dz}|dxxd|jzz cc<|S)z%Assemble request for the Peertube APIFsearxng_localeN/z/api/v1/search/videos?z search-indexrpagenor z-match safesearch)search searchTarget resultTypestartcountsortnsfwurlz&languageOneOf[]=z&boostLanguages[]= time_rangez &startDate=) traits get_languagebase_urlrstriprsafesearch_tabletime_range_tablernowdate isoformat)queryparamseng_langtimes '/root/searxng/searx/engines/peertube.pyrequestr>2s ""6*:#;TBH  " #  .& *Q."4 ( )=>    5M"u ,x77 u -88  l//||~""$'7|8L'MMu )999 Mct|S)N)video_response)resps r=responserCWs $ r?c.g}|j}d|vrgS|dD]n}|jdijd|jdijddz|jdijdzdj|jdgfDcgc]}|r|}}|jd }|r t| }|j |d |dt |jd xsd |jdijd|t |ddt|d|jd|jdxs|jddj|d q|Scc}w)z=Parse video response from SepiaSearch and Peertube instances.datachannel displayNamename@host, tagsduration)secondsr. descriptionaccountviewsz videos.html publishedAtembedUrl thumbnailUrl previewUrlz | ) r.titlecontentauthorlengthrRtemplate publishedDate iframe_src thumbnailmetadata)jsongetjoinrappendr r r)rBr json_dataresultxr_rMs r=rArA[sG I Y F#  9b)--m< 9b)--f5;fjjTV>W>[>[\b>cc &**VR01     ::j)  2He}' =(A(GRH **Y377 F"(9)!&vm' N= s+ F engine_traitsc ddlm}|dd}|js tdt j d|j tj}|s tdy t jd |jd D]}|jd }|d k(r ttjj|}|j j|}|r||k7rtd|d|d|z||j |<d|j d<d|j d<y #tj$rtd |zYwxYw)aFetch languages from peertube's search-index source code. See videoLanguages_ in commit `8ed5c729 - Refactor and redesign client`_ .. _8ed5c729 - Refactor and redesign client: https://framagit.org/framasoft/peertube/search-index/-/commit/8ed5c729 .. _videoLanguages: https://framagit.org/framasoft/peertube/search-index/-/commit/8ed5c729#3d8747f9a60695c367c70bb64efba8f403721fad_0_291 r)razchttps://framagit.org/framasoft/peertube/search-index/-/raw/master/client/src/components/Filters.vue)timeoutz!Response from Peertube is not OK.z videoLanguages \(\)[^\n]+(.*?)\]z.ERROR: can't determine languages from peertubeNz\{ id: '([a-z]+)', label:roczERROR: %s is unknown by babelzCONFLICT: babel z --> rKzhzh_Hanszh_Hant) searx.networkraok RuntimeErrorrer'textDOTALLprintfinditergroupr babelLocalerUnknownLocaleError languages)rgrarBjs_langlangeng_tagsxng_tagconflicts r= fetch_traitsrs@" m D 77>??ii;TYY RG  >? 8'--:JK4**Q- d?  #ELL$6$6w$?@H !**..x8 7"8WUV ,3 )%4(*.MI&)-MI&''  1G; <  s%(D44!EE)__doc__rrrr urllib.parserrxdateutil.parserrdateutil.relativedeltarsearx.enginelib.traitsr searx.localesr searx.utilsr r about categoriespagingr2time_range_supportr5r&r4r>rCrArr?r=rs  (" !0/&5*"{ Z    ?  # " %  #  'g6"J (V/. /.r?