o h'-@sddlZddlmZmZmZmZmZddlZGdddZe dkrneZ e e e de e j ddd e d e e j d d e d e e j dd e de e j dddd de de e j dddddSdS)N)OptionalLiteralListDictTuplec @seZdZdZddZddedeefddZ dd e e d d e ede ede e ddedef ddZ de eeffddZ ddZdedeeeffddZdedefddZd S)UserAgentGeneratora| Generate random user agents with specified constraints. Attributes: desktop_platforms (dict): A dictionary of possible desktop platforms and their corresponding user agent strings. mobile_platforms (dict): A dictionary of possible mobile platforms and their corresponding user agent strings. browser_combinations (dict): A dictionary of possible browser combinations and their corresponding user agent strings. rendering_engines (dict): A dictionary of possible rendering engines and their corresponding user agent strings. chrome_versions (list): A list of possible Chrome browser versions. firefox_versions (list): A list of possible Firefox browser versions. edge_versions (list): A list of possible Edge browser versions. safari_versions (list): A list of possible Safari browser versions. ios_versions (list): A list of possible iOS browser versions. android_versions (list): A list of possible Android browser versions. Methods: generate_user_agent( platform: Literal["desktop", "mobile"] = "desktop", browser: str = "chrome", rendering_engine: str = "chrome_webkit", chrome_version: Optional[str] = None, firefox_version: Optional[str] = None, edge_version: Optional[str] = None, safari_version: Optional[str] = None, ios_version: Optional[str] = None, android_version: Optional[str] = None ): Generates a random user agent string based on the specified parameters. cCsddddddddd d d |_d d ddddddd|_dgdgdgdggddgddgddgggdgdgd|_ddgd d!|_gd"|_gd#|_gd$|_gd%|_dS)&Nz(Windows NT 10.0; Win64; x64)z(Windows NT 10.0; WOW64))10_6410_32z#(Macintosh; Intel Mac OS X 10_15_7)z+(Macintosh; Intel Mac OS X 10.15; rv:109.0))intelnewerz(X11; Linux x86_64)z(X11; Ubuntu; Linux x86_64)z(X11; CrOS x86_64 14541.0.0))genericubuntu chrome_os)windowsmacoslinuxz(Linux; Android 13; SM-S901B)z(Linux; Android 12; Pixel 6)z"(Linux; Android 13; OnePlus 9 Pro)z(Linux; Android 12; M2102J20SG))samsungpixeloneplusxiaomiz*(iPhone; CPU iPhone OS 16_5 like Mac OS X)z!(iPad; CPU OS 16_5 like Mac OS X))iphoneipad)androidioschromefirefoxsafariedgegeckowebkit)rrr)rrr)zAppleWebKit/537.36zAppleWebKit/605.1.15)Gecko/20100101r#z Gecko/2010010) chrome_webkit safari_webkitr)zChrome/119.0.6045.199zChrome/118.0.5993.117zChrome/117.0.5938.149zChrome/116.0.5845.187zChrome/115.0.5790.171)zEdg/119.0.2151.97zEdg/118.0.2088.76zEdg/117.0.2045.47zEdg/116.0.1938.81zEdg/115.0.1901.203)z Safari/537.36zSafari/605.1.15z Safari/604.1z Safari/602.1zSafari/601.5.17) z Firefox/119.0zFirefox/118.0.2zFirefox/117.0.1z Firefox/116.0zFirefox/115.0.3zFirefox/114.0.2zFirefox/113.0.1z Firefox/112.0zFirefox/111.0.1z Firefox/110.0)desktop_platformsmobile_platformsbrowser_combinationsrendering_engineschrome_versions edge_versionssafari_versionsfirefox_versions)selfr/Z/var/www/Befach/backend/venv/lib/python3.10/site-packages/crawl4ai/user_agent_generator.py__init__#sR   zUserAgentGenerator.__init__r num_browsersreturncCs||jvr td|t|j|}g}|D]V}|dkr(|t|jq|dkr6|t|jq|dkrD|t|jq|dkrR|t|jq|dkrb|t|j dq|dkrn||j dq|S) a Get a valid combination of browser versions. How it works: 1. Check if the number of browsers is supported. 2. Randomly choose a combination of browsers. 3. Iterate through the combination and add browser versions. 4. Return the browser stack. Args: num_browsers: Number of browser specifications (1-3) Returns: List[str]: A list of browser versions. z Unsupported number of browsers: rrrrrrr$) r( ValueErrorrandomchoiceappendr*r-r,r+r))r.r2 combination browser_stackbrowserr/r/r0get_browser_stacks& z$UserAgentGenerator.get_browser_stackNr" device_type)desktopmobileos_type device_brand browser_typerrrrc Cs||||}d|g}||}dt|vr"|t|jdndt|vs.dt|vr;||jd|d||d|S) a Generate a random user agent with specified constraints. Args: device_type: 'desktop' or 'mobile' os_type: 'windows', 'macos', 'linux', 'android', 'ios' device_brand: Specific device brand browser_type: 'chrome', 'edge', 'safari', or 'firefox' num_browsers: Number of browser specifications (1-3) z Mozilla/5.0FirefoxrChromeSafarir$z(KHTML, like Gecko) ) get_random_platformr;strr7r5r6r)extendjoin) r.r<r?r@rAr2platform componentsr9r/r/r0generates     zUserAgentGenerator.generatecKs"|jdi|}||}||fS)z2Generate both user agent and matching client hintsNr/)rMgenerate_client_hints)r.kwargs user_agent client_hintsr/r/r0generate_with_client_hintss z-UserAgentGenerator.generate_with_client_hintscCs|dkr|jn|dkr|jni|j|j}|r-|j|jfD]}||vr,|||i}nqtt|}|rD|||vrD|||Stt||S)z9Helper method to get random platform based on constraintsr=r>)r&r'r5r6listkeysvalues)r.r<r?r@ platformsplatform_groupos_keyr/r/r0rGs  z&UserAgentGenerator.get_random_platformrPcCsFddddd}i}|D]\}}t||}|r |d||<q |S)zDParse a user agent string to extract browser and version informationz Chrome/(\d+)z Edg/(\d+)z Version/(\d+)z Firefox/(\d+)rBr )itemsresearchgroup)r.rPbrowsersresultr:patternmatchr/r/r0parse_user_agents z#UserAgentGenerator.parse_user_agentcCs||}g}d|vr7|d|dd|dd|vr+|d|ddn&|d|ddnd|vr=d Sd |vrQ|d |d d|dd |S) z:Generate Sec-CH-UA header value based on user agent stringrz"Chromium";v=""z"Not_A Brand";v="8"rz"Microsoft Edge";v="z"Google Chrome";v="rz""rz "Safari";v="z, )rar7rJ)r.rPr]hintsr/r/r0rNs    z(UserAgentGenerator.generate_client_hints)r )NNNNr")__name__ __module__ __qualname____doc__r1intrrHr;rrrMrrRrGrrarNr/r/r/r0rs4d'   %r__main__z Single browser (Chrome):r r)r2rAz Two browsers (Gecko/Firefox):r!)r2z% Three browsers (Chrome/Safari/Edge):r"z Firefox on Linux:r=rr)r<r?rAr2z Chrome/Safari/Edge on Windows:r)r<r?r2) r5typingrrrrrrZrrd generatorprintrMr/r/r/r0s: