관리-도구
편집 파일: connection.cpython-38.pyc
U )�e� � @ s� d Z ddlZddlZddlZddlZddlmZ ddlmZ ddlm Z ddl Z ddl Z ddl Z z,ddl mZmZmZ ddlZddlmZ W n@ ek r� ddlmZmZmZ ddlmZ ddlmZ Y nX ejd dk�rzdd lmZ W n ek �r d ZY nX d Zn0zdd lmZ W n ek �r: d ZY nX d Zddl Z dd l m Z dd l m!Z! ddl"m#Z# ddl$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z* ddl+m,Z,m-Z-m.Z.m/Z/ ddl0m1Z1 ddl0m2Z2m3Z3 ddl4m5Z5 ddl6m7Z7 ddl0m8Z8 ddl9m:Z:m;Z;m<Z< e1j=e1j>fZ?e1j=e1j@e1jAe1jBe1jCfZDg aEdZFddd�ZGi ZHdZId ZJdZKd ZLdZMdZNd ZOdZPdZQdZRd ZSd ZTd ZUd ZVeWfd dfeXeYeWejejZge[e<� �d!dfeXe[fd"dfeYfd#eOfeWfd$dfeWfd%dfeWfd&eUfeYfd'eLfeYfd(eKfd)� Z\e �]d*�Z^G d+d,� d,e_�Z`G d-d.� d.e_�ZaG d/d0� d0e_�ZbG d1d2� d2eb�ZcG d3d4� d4e_�ZdG d5d6� d6ed�Zed7d8� Zfd9d:� Zgd;d<� Zhd=d>� Zie�r�G d?d@� d@ejj�ZkG dAdB� dBe�ZlG dCdD� dDe_�ZmG dEdF� dFe_�ZnG dGdH� dHen�ZoG dIdJ� dJen�ZpG dKdL� dLe_�ZqdS )Mz,Implementing communication with MySQL Fabric� N)� b16decode)�bisect)�md5)�Fault� ServerProxy� Transport)� BadStatusLine� )�HTTPSConnectionFT)�MySQLConnection)�MySQLConverter)�MySQLConnectionPool)�Error�InterfaceError�NotSupportedError�MySQLFabricError� InternalError� DatabaseError)� MySQLCursor�MySQLCursorBuffered�MySQLCursorRaw�MySQLCursorBufferedRaw)� errorcode� )�FabricMySQLServer� FabricShard)� FabricCache)�WeightedRoundRobin��version)�PY2� isunicode� UNICODE_TYPES�xmlrpci~ i~ )r# �mysql� �GLOBAL�LOCALZFAULTYzName of group of serversz Sharding keyzList of tables in queryz#Read-Only, Write-Only or Read-Writez+Identity of the shard for direct connection� z+GLOBAL for accessing Global Group, or LOCALz Attempts for getting connectionz$Seconds to wait between each attempt) �group�key�tables�modeZshard�mapping�scope�attempts� attempt_delayzmyconnpy-fabricc @ sB e Zd ZdZdd� Zdd� Zdd� Zdd d �Zd d � Zd d� Z dS )�MySQLRPCProtocolz0Class using MySQL protocol to query Fabric. c C s( t � | _t|||||�| _| j�� d S �N)r � converter�FabricMySQLConnection�handler�connect��self�fabric�host�port�connect_attempts� connect_delay� r> �v/opt/hc_python/lib64/python3.8/site-packages/../../../lib/python3.8/site-packages/mysql/connector/fabric/connection.py�__init__� s �zMySQLRPCProtocol.__init__c C s� z\g }t |�� �D ]F\}}|}| j�|�}| j�|�}| j�|�}|�d�|t|��� qW n4 t k r� } zt j j � d| ��W 5 d}~X Y nX |S dS )z,Process query parameters given as dictionaryz{0}={1}z)Failed processing pyformat-parameters; %sN)�list�itemsr3 �to_mysql�escape�quote�append�format�str� Exceptionr$ � connector�errors�ProgrammingError)r8 �params�resr* �value�conv�errr> r> r? �_process_params_dict� s �z%MySQLRPCProtocol._process_params_dictc s� zL|}� fdd�|D �}� fdd�|D �}� fdd�|D �}dd� |D �}W n4 t k r� } ztjj�d| ��W 5 d}~X Y n X t|�S dS )zProcess query parameters.c s g | ]}� j �|��qS r> )r3 rC ��.0�i�r8 r> r? � <listcomp>� s z4MySQLRPCProtocol._process_params.<locals>.<listcomp>c s g | ]}� j �|��qS r> )r3 rD rS rV r> r? rW � s c s g | ]}� j �|��qS r> )r3 rE rS rV r> r? rW � s c S s g | ] }t |��qS r> )rH rS r> r> r? rW � s z'Failed processing format-parameters; %sN)rI r$ rJ rK rL �tuple)r8 rM rN rQ r> rV r? �_process_params� s �z MySQLRPCProtocol._process_paramsNc C sD |sd}| j jjdd�}g }|j||dd�D ]}|�|�� � q,|S )zYExecutes the given query Returns a list containing response from Fabric r> T)� dictionary)�multi)r5 � connection�cursor�executerF Zfetchall)r8 �stmtrM �cur�resultsrN r> r> r? � _execute_cmd� s z MySQLRPCProtocol._execute_cmdc O sB g }|r | � |�}|�|� |r4| �|�}|�|� d�|�}|S )z6Process arguments to create query parameters. z, )rY �extendrR �join)r8 �args�kwargsrM r> r> r? � create_params� s z MySQLRPCProtocol.create_paramsc O s� | j ||�}d�|||�}d}z| �|�}t|�}W nF ttjtfk rz } z dj||t| �d�} t| ��W 5 d} ~ X Y nX |S )z�Executes the given command with MySQL protocol Executes the given command with the given parameters. Returns an iterator to navigate to navigate through the result set returned by Fabric zCALL {0}.{1}({2})N�+Executing {group}.{command} failed: {error}�r) �command�error) rg rG rb �FabricMySQLSetr �socketrk r rH ) r8 r) rj re rf rM �cmd�fab_set�data�exc�msgr> r> r? r^ � s �zMySQLRPCProtocol.execute)N) �__name__� __module__� __qualname__�__doc__r@ rR rY rb rg r^ r> r> r> r? r1 � s r1 c @ s e Zd ZdZdd� Zdd� ZdS )�XMLRPCProtocolz2Class using XML-RPC protocol to query Fabric. c C s t |||||�| _| j�� d S r2 )�FabricXMLRPCConnectionr5 r6 r7 r> r> r? r@ � s �zXMLRPCProtocol.__init__c O s� z t | jj|�}t ||�}W n: tk rV } z tdj||t|�d���W 5 d}~X Y nX d}z|||�} t| �}W nF tt j t fk r� } z dj||t|�d�} t | ��W 5 d}~X Y nX |S )z�Executes the given command with XML-RPC protocol Executes the given command with the given parameters Returns an iterator to navigate to navigate through the result set returned by Fabric z'{group}.{command} not available ({err}))r) rj rQ Nrh ri ) �getattrr5 �proxy�AttributeError� ValueErrorrG rH � FabricSetr rm rk r ) r8 r) rj re rf �grprn rq ro rp rr r> r> r? r^ � s* � �zXMLRPCProtocol.executeN)rs rt ru rv r@ r^ r> r> r> r? rw � s rw c @ s e Zd ZdZdd� ZdS )�FabricMySQLResponsezHClass used to parse a response got from Fabric with MySQL protocol. c C sN |d d }|d |d |d }}}|r4t |��|| _|| _|d | _d S )Nr � fabric_uuid�ttl�messager )r �fabric_uuid_strr� � coded_rows)r8 rp �infor� r� rk r> r> r? r@ s � z FabricMySQLResponse.__init__N)rs rt ru rv r@ r> r> r> r? r s r c s8 e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Z� ZS ) rl z^Iterator to navigate through the result set returned from Fabric with MySQL Protocol. c s< t t| ��|� | jd �� | _| j| _t�d| j�| _ dS )�)Initialize the FabricSet object. r � ResultSetN) �superrl r@ r� �keysZ_FabricMySQLSet__names�_FabricMySQLSet__rows� collections� namedtuple�_FabricMySQLSet__result�r8 rp �� __class__r> r? r@ ( s zFabricMySQLSet.__init__c C s t | j�S �z.The number of rows in the result set. )�lenr� rV r> r> r? �rowcount0 s zFabricMySQLSet.rowcountc c s | j D ]}| jf |�V qdS �zUIterate over the rows of the result set. Each row is a named tuple. N)r� r� �r8 �rowr> r> r? �rows5 s zFabricMySQLSet.rowsc C s | j f | j| �S �zGIndexing method for a row. Each row is a named tuple. )r� r� �r8 �indexr> r> r? r� = s zFabricMySQLSet.row� rs rt ru rv r@ r� r� r� � __classcell__r> r> r� r? rl $ s rl c @ s e Zd ZdZdZdd� ZdS )�FabricResponsez4Class used to parse a response got from Fabric. r c C sT |\}}}}}|rt |��|tjkr8t djtj|d���|| _|| _|| _|| _dS )z-Initialize the FabricResponse object zdSupported protocol has version {sversion}. Got a response from MySQL Fabric with version {gversion}.)ZsversionZgversionN)r r� �SUPPORTED_VERSIONrG �format_versionr� r� r� )r8 rp r� r� r� rk r� r> r> r? r@ K s ��zFabricResponse.__init__N)rs rt ru rv r� r@ r> r> r> r? r� E s r� c s8 e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Z� ZS ) r} zEIterator to navigate through the result set returned from Fabric c s� t t� ��|� t� j�dks"t�� jd d d � _� jd d � _t� fdd�� jD ��spt� j�dkspt�t � d� j�� _ d S ) r� r r r� �namesr� c 3 s | ]}t � j�t |�kV qd S r2 )r� �_FabricSet__names)rT r� rV r> r? � <genexpr>h s z%FabricSet.__init__.<locals>.<genexpr>r� N) r� r} r@ r� r� �AssertionErrorr� �_FabricSet__rows�allr� r� �_FabricSet__resultr� r� rV r? r@ a s �zFabricSet.__init__c C s t | j�S r� )r� r� rV r> r> r? r� l s zFabricSet.rowcountc c s | j D ]}| j|� V qdS r� )r� r� r� r> r> r? r� q s zFabricSet.rowsc C s | j | j| � S r� )r� r� r� r> r> r? r� y s z FabricSet.rowr� r> r> r� r? r} ^ s r} c C sV | sg a t| ttf�s | g} | D ]0}t|t�r>|dkr>|dk sFtd��t �|� q dS )ax Add MySQL error to be reported to Fabric This function adds error_codes to the error list to be reported to Fabric. To reset the custom error reporting list, pass None or empty list. The error_codes argument can be either a MySQL error code defined in the errorcode module, or list of error codes. Raises AttributeError when code is not an int. i� i� z Unknown or invalid error code.N)�REPORT_ERRORS_EXTRA� isinstancerA rX �intr{ rF )Z error_codes�coder> r> r? �extra_failure_report� s r� c C s dj | |d�S )z�Create an XMLRPC URI for connecting to Fabric This method will create a URI using the host and TCP/IP port suitable for connecting to a MySQL Fabric instance. Returns a URI. zhttp://{host}:{port}�r: r; )rG r� r> r> r? �_fabric_xmlrpc_uri� s r� c C s t �t jt| |��S )z!Create a UUID using host and port)�uuid�uuid3� NAMESPACE_URLr� r� r> r> r? �_fabric_server_uuid� s r� c C sN t s td��t| ||g�rJ| s&td��|s.|r>|r6|s>td��| ||d�S dS )zvValidate the SSL argument. Raises AttributeError is required argument is not set. Returns dict or None. �Python does not support SSLzMissing ssl_ca argument.z;ssl_key and ssl_cert need to be both specified, or neither.)�car* �certN)�HAVE_SSLr �anyr{ )�ssl_ca�ssl_key�ssl_certr> r> r? �_validate_ssl_args� s ��r� c s2 e Zd ZdZ� fdd�Zdd� Zd dd�Z� ZS ) �FabricHTTPSHandlerz Class handling HTTPS connectionsc s& t rtj�| � n t� �� || _dS �� InitializeN)r �urllib2� HTTPSHandlerr@ r� � _ssl_config)r8 � ssl_configr� r> r? r@ � s zFabricHTTPSHandler.__init__c C s | � | j|�S )zOpen HTTPS connection)�do_open�get_https_connection)r8 �reqr> r> r? � https_open� s z FabricHTTPSHandler.https_open�, c C s t || jd | jd d�S )zReturns a HTTPSConnectionr* r� )�key_file� cert_file)r r� )r8 r: �timeoutr> r> r? r� � s �z'FabricHTTPSHandler.get_https_connection)r� )rs rt ru rv r@ r� r� r� r> r> r� r? r� � s r� c s8 e Zd ZdZd�ej�Zd � fdd� Zd dd �Z � Z S ) �FabricTransportz"Custom XMLRPC Transport for FabriczMySQL Connector Python/{0}r FNc s� t rtj| dd� nt� jdd� || _|| _|| _|| _|| _|| _g | _| jrr| jrrt � � | _ t � | j �| _ n d| _ d| _ |r�| j�|� d| _nd| _| j r�| j�| j � dS )r� F)� use_datetimeN�https�http)r r r@ r� � _username� _password� _use_datetime�verbose� _handlersr� � HTTPPasswordMgrWithDefaultRealm�_passmgr�HTTPDigestAuthHandlerZ _auth_handlerrF �_scheme)r8 �username�passwordr� r� � https_handlerr� r> r? r@ � s* zFabricTransport.__init__c C s: dj | j||d�}| jr.| j�d|| j| j� | jrDt�d� |�� t j | j � }d| j d�}t j |||d�}z| �|�|��W S t jt jfk �r } zrz2d} | jd kr�d } | j} n| j} d j | | d �} W n. tk r� d t| �kr�d} nt| �} Y nX td| ��W 5 d} ~ X Y n tk �r4 td��Y nX dS )zSend XMLRPC requestz{scheme}://{host}{handler})�schemer: r5 NzFabricTransport: {0}ztext/xml)z Content-Typez User-Agent)�headers���i� zPermission deniedz{reason} ({code}))�reasonr� ZSSLz SSL errorz Connection with Fabric failed: z(Connection with Fabric failed: check SSL)rG r� r� � add_passwordr� r� r� �_LOGGER�debugr� � build_openerr� � user_agent�Request�parse_response�open�URLError� HTTPErrorr� r� r{ rH r r ) r8 r: r5 � request_bodyr� �uri�openerr� r� rq r� r� rr r> r> r? �request s@ �� � zFabricTransport.request)r FN)r ) rs rt ru rv rG r Z VERSION_TEXTr� r@ r� r� r> r> r� r? r� � s � r� c @ s� e Zd ZdZdddeedddddef dd�Zedd� �Z edd � �Z ed d � �Z d!d d �Z d"dd�Z dd� Zdd� Zd#dd�Zd$dd�Zd%dd�Zd&dd �Zedfd d �Zd d � ZdS )'�Fabricz%Class managing MySQL Fabric instancesNFc C s� | dkrt | _n | dkr t| _ntd�| ���|s:t| }i | _d| _d| _d| _ || _ || _ t � | _ i | _|| _|| _t|| | �| _|| _| | _| r�|r�td��| p�|| _|| _dS )r� r# r$ z0Protocol not supported by MySQL Fabric, was '{}'N�< z&can not specify both user and username)rw �_protocol_classr1 r rG �MYSQL_FABRIC_PORT�_fabric_instances� _fabric_uuid�_ttl�_version_token�_connect_attempts�_connect_delayr �_cache�_group_balancers� _init_host� _init_portr� �_ssl�_report_errors� _protocolr| r� r� ) r8 r: r� r� r; r< r= Z report_errorsr� r� r� �user�protocolr> r> r? r@ 1 s8 �� zFabric.__init__c C s | j S )z0Return username used to authenticate with Fabric)r� rV r> r> r? r� W s zFabric.usernamec C s | j S )z0Return password used to authenticate with Fabric)r� rV r> r> r? r� \ s zFabric.passwordc C s | j S )z Return the SSL configuration)r� rV r> r> r? r� a s zFabric.ssl_configc C s� |p| j }|p| j}| j| ||| j| jd�}| �|�\}}}}|sJtd��| j|krXdS t� dj |d�� || _ || _|dkr�|| _ |D ]\}| j| |d |d | j| jd�} | j j} | | jkr�| | j| < t�d j | j j| j jd �� q�dS ) z�Get MySQL Fabric Instances This method uses host and port to connect to a MySQL Fabric server and get all the instances managing the same metadata. Raises InterfaceError on errors. )r< r= z%Failed getting list of Fabric serversNz.Loading Fabric configuration version {version}r r r: r; z%Added new Fabric server {host}:{port}r� )r� r� r� r� r� �get_fabric_serversr r� r� r� rG r� r� r5 r� r� r� r: r; ) r8 r: r; Zfabinstr� �fabric_versionr� Zfabricsr9 �instZ inst_uuidr> r> r? �seedf sH �� ��� ��z Fabric.seedc C s< |r&t �dj|d�� | j|dd� nt �d� t� | _dS )zWReset cached information This method destroys all cached information. z#Resetting cache for group '{group}'�r) F�� use_cachezResetting cacheN)r� r� rG �get_group_serversr r� �r8 r) r> r> r? � reset_cache� s � zFabric.reset_cachec C sb d}d}| j st|d ��tr8| j �� }| j || }n| j t| j �| }|jjs^|j�� |S )z�Get a MySQL Fabric Instance This method will get the next available MySQL Fabric Instance. Raises InterfaceError when no instance is available or connected. r z"No MySQL Fabric instance availablez (not seeded?))r� r r r� rA r5 � is_connectedr6 )r8 Znxt�errmsgZ instance_listr r> r> r? � get_instance� s zFabric.get_instancec C s� | j s dS t|�}t�� }|tks*|tkr�t�d||� | �� }z |� dd|||�}t |� W n8 t tj fk r� } zt�dt |�� W 5 d}~X Y nX dS )z{Report failure to Fabric This method sets the status of a MySQL server identified by server_uuid. Nz Reporting error %d of server %sZthreat�report_failurez&Failed reporting server to Fabric (%s))r� r� rm �getfqdn� REPORT_ERRORSr� r� r� r r^ r� r rk rH )r8 � server_uuid�errnoZ current_hostr rp rq r> r> r? r � s( � � �zFabric.report_failurec C s( |p | � � }g }d}z:|�ddd| j �}|�� D ]}|�|j|jd�� q2W n� ttj fk r� } z(|j t |�|j j|j jd�}t |��W 5 d}~X Y nL ttfk r� } z*|j d� |�|j j|j jd�}t |��W 5 d}~X Y nX zt�|j�} W n tk �r t�� } Y nX d } | | |j|fS ) a� Get all MySQL Fabric instances This method looks up the other MySQL Fabric instances which uses the same metadata. The returned list contains dictionaries with connection information such ass host and port. For example: [ {'host': 'fabric_prod_1.example.com', 'port': 32274 }, {'host': 'fabric_prod_2.example.com', 'port': 32274 }, ] Returns a list of dictionaries z;Looking up Fabric servers failed using {host}:{port}: {err}�dumpZ fabric_nodesz protocol.r� )rQ r: r; Nz No Fabric server available ({0})r )r r^ r� r� rF r: r; r rm rk rG rH r5 r � TypeErrorr{ r� �UUIDr� �uuid4r� ) r8 Z fabric_cnxr �result�err_msg�fsetr� rq rr r� r r> r> r? r� � s6 � � �zFabric.get_fabric_serversTc C s |r| j �|�}|r|jS | �� }g }z|�dd| j|�}W nB ttjfk r~ } z dj t |�|d�}t |��W 5 d}~X Y nX g } |� � D ]V} | j |kr�t| j| j | j| j| j| j| j�} |�| � | jtkr�| �| j| jf� q�| j �||� | �rt| � | j|< |S )a? Get all MySQL servers in a group This method returns information about all MySQL part of the given high-availability group. When use_cache is set to True, the cached information will be used. Raises InterfaceError on errors. Returns list of FabricMySQLServer objects. r �serversz:Looking up MySQL servers failed for group {group}: {error})rk r) N)r� Z group_searchr r r^ r� r rm rk rG rH r r� �group_idr r r: r; r, �status�weightrF �STATUS_SECONDARYr� Z cache_groupr r� ) r8 r) r �entryr r r rq rr �weightsr� � mysqlserverr> r> r? r � sB � � zFabric.get_group_serversc C s |r|rt d��d}| j|dd�}|s6t|j|d���d}g }|D ](}|jtkr\|�|� qB|jtkrB|}qB|tt fks�|tkr�|s�| j |d� t|d j|r�dnd ||p�|d ���|S |s�|r�|S || j kr�| j | � � d } |D ]} | | j kr�| S q�| j |d� t|j||d ���dS ) a� Get a MySQL server from a group The method uses MySQL Fabric to get the correct MySQL server for the specified group. You can specify mode or status, but not both. The mode argument will decide whether the primary or a secondary server is returned. When no secondary server is available, the primary is returned. Status is used to force getting either a primary or a secondary. The returned tuple contains host, port and uuid. Raises InterfaceError on errors; ValueError when both mode and status are given. Returns a FabricMySQLServer object. z-Either mode or status must be given, not bothz-No MySQL server available for group '{group}'Tr r Nz {query}={value}r r, )�queryr) rO r )r) r, )r| r r rG r r rF �STATUS_PRIMARY�MODE_WRITEONLY�MODE_READWRITEr r� Zget_nextr� ) r8 r) r, r r r �primaryZ secondary�serverZnext_secondaryr r> r> r? �get_group_server$ sB � � zFabric.get_group_serverc C s$ t |ttf�std��g }|D ]^}t |ttf�sB|sBtd�|���t |ttf�rb|d }|d }n|}|}|�d�||�� q | �� }z |�dd| jd� |��}W n@ t t j fk r� } z d jt | �d �} t| ��W 5 d } ~ X Y nX |�� D ]2} | j�t| j| j| j| j| j| j| j| j�� q�d S ) a� Get and cache the sharding information for given tables This method is fetching sharding information from MySQL Fabric and caches the result. The tables argument must be sequence of sequences contain the name of the database and table. If no database is given, the value for the database argument will be used. Examples: tables = [('salary',), ('employees',)] get_sharding_information(tables, database='employees') tables = [('salary', 'employees'), ('employees', employees)] get_sharding_information(tables) Raises InterfaceError on errors; ValueError when something is wrong with the tables argument. �tables should be a sequencez#No database specified for table {0}r r z{0}.{1}r Zsharding_information�,z0Looking up sharding information failed : {error}�rk N)r� rA rX r| rG rF r r^ r� rd r rm rk rH r r� r� Zsharding_cache_tabler Z schema_nameZ table_nameZ column_name� lower_boundZshard_id� type_namer � global_group) r8 r+ �database�patterns�tableZdbase�tblr r rq rr r� r> r> r? �get_sharding_information` sJ � �� ��z Fabric.get_sharding_informationc s� t |ttf�std��g � |D �]�}z|�d�\}}W n" tk rX td�|���Y nX | j�||�}|s�| �|f|� | j�||�}|s�t t j dj||d�d��|dkr�| j |j |d� S |jd k�r z t|�} W n tk r� td ��Y nX |j} | t| | �d } |j| } �nf|jd k�r�t |tjtjf��sDtd ��d} |jD ]} || k�rN| } �qj�qNz|j| } W n$ tk �r� td�|���Y nX n�|jdk�rt|��s�td��d} |jD ]} || k�r�| } �q�q�z|j| } W n$ tk �r td�|���Y nX nh|jdk�rrtt|��}|jd } |jD ]"} |�� t| �k�rB| } �qf�qB|j| } nt d�|j���� � | d � t � fdd�� D ��s t d��q | j � d |d�S )a" Get MySQL server information for a particular shard Raises DatabaseError when the table is unknown or when tables are not on the same shard. ValueError is raised when there is a problem with the methods arguments. InterfaceError is raised for other errors. r' �.z5tables should be given as <database>.<table>, was {0}z"Unknown table '{database}.{table}')r- r/ )r rr r& �r, �RANGEz Key must be an integer for RANGEr ZRANGE_DATETIMEzAKey must be datetime.date or datetime.datetime for RANGE_DATETIMENzKey invalid; was '{0}'Z RANGE_STRINGzKey must be a unicode value�HASHr� z Unsupported sharding type {0}r) c 3 s | ]}|� d kV qdS )r Nr> )rT r) ��groupsr> r? r� � s z*Fabric.get_shard_server.<locals>.<genexpr>z'Tables are located in different shards.r ) r� rA rX r| �splitrG r� Zsharding_searchr1 r r ZER_BAD_TABLE_ERRORr& r, Z shard_typer� r� r Z partitioning�datetime�dateZ keys_reversed�KeyErrorr! r rH �digestr r rF r� )r8 r+ r* r. r, Zdbobjr- r/ r Z range_keyZ partitionsr� � partitionZpartkeyZmd5keyr> r6 r? �get_shard_server� s� �� �� � ��zFabric.get_shard_serverc O s | � � }|j||f|�|�S )ai Execute a Fabric command from given group This method will execute the given Fabric command from the given group using the given arguments. It returns an instance of FabricSet. Raises ValueError when group.command is not valid and raises InterfaceError when an error occurs while executing. Returns FabricSet. )r r^ )r8 r) rj re rf r r> r> r? r^ � s zFabric.execute)NN)N)N)T)NN)NN)rs rt ru rv �_CNX_ATTEMPT_MAX�_CNX_ATTEMPT_DELAY�DEFAULT_FABRIC_PROTOCOLr@ �propertyr� r� r� r r r r r� r r& r1 � SCOPE_LOCALr> r^ r> r> r> r? r� - s8 � & - * - < 7Vr� c @ sd e Zd ZdZee eefdd�Ze dd� �Z e dd� �Z e dd � �Z d d � Z e d d � �Zdd� ZdS )�FabricConnectionzIBase Class for a class holding a connection to a MySQL Fabric server c C s4 t |t�std��|| _|| _|| _|| _|| _dS )r� z'fabric must be instance of class FabricN)r� r� r| �_fabric�_host�_portr� r� r7 r> r> r? r@ � s zFabricConnection.__init__c C s | j S )z6Returns server IP or name of current Fabric connection)rF rV r> r> r? r: s zFabricConnection.hostc C s | j S )z0Returns TCP/IP port of current Fabric connection)rG rV r> r> r? r; s zFabricConnection.portc C s t | j| j�S )z7Returns UUID of the Fabric server we are connected with)r� rF rG rV r> r> r? r� s zFabricConnection.uuidc C s dS �zConnect with MySQL FabricNr> rV r> r> r? r6 s zFabricConnection.connectc C s dS )��Check whether connection with Fabric is valid Return True if we can still interact with the Fabric server; False if Not. Returns True or False. Nr> rV r> r> r? r s z FabricConnection.is_connectedc C s dj | j| j| jd�S )Nz"{class_}(host={host}, port={port}))�class_r: r; )rG r� rF rG rV r> r> r? �__repr__* s �zFabricConnection.__repr__N)rs rt ru rv r� rA r? r@ r@ rB r: r; r� r6 r rK r> r> r> r? rD � s � rD c s` e Zd ZdZed eef� fdd� Zedd� �Z edd� �Z d d � Z d d � Z ed d� �Z � ZS )rx zCClass holding a connection to a MySQL Fabric server through XML-RPCr# c s" t t| ��|||||� d| _dS r� )r� rx r@ �_proxyr7 r� r> r? r@ 6 s �z FabricXMLRPCConnection.__init__c C s | j S )z5Returns the XMLRPC Proxy of current Fabric connection)rL rV r> r> r? rz ? s z FabricXMLRPCConnection.proxyc C s t | j| j�S )z4Returns the XMLRPC URI for current Fabric connection)r� rF rG rV r> r> r? r� D s zFabricXMLRPCConnection.uric C s | j r | jS | j}| j}d}d}||k�r |d7 }zZ| jjrVtsHtd��t| jj�}nd}t | jj | jj d|d�}t | j |dd�}|�� W nj tk r� | Y S tjk r� } z4||kr�td�|���t�dj| j| j|d �� W 5 d}~X Y nX |dkr t�|� q dS ) z�Return the XMLRPC server proxy instance to MySQL Fabric This method tries to get a valid connection to a MySQL Fabric server. Returns a XMLRPC ServerProxy instance. Nr r r� )r� r� )� transportr� �'Connection to MySQL Fabric failed ({0})�*Retrying {host}:{port}, attempts {counter}�r: r; �counter)r rL r� r� rE r� r� r r� r� r� r� r r� �_some_nonexisting_methodr rm rk rG r� r� r: r; �time�sleep)r8 r/ �delayrz rQ r� rM rq r> r> r? �_xmlrpc_get_proxyI sJ � � ��z(FabricXMLRPCConnection._xmlrpc_get_proxyc C s | � � | _dS rH )rV rL rV r> r> r? r6 v s z FabricXMLRPCConnection.connectc C sF z| j �� W n. tk r$ Y dS ttfk r< Y dS X dS dS )rI TFN)rL rR r r r{ rV r> r> r? r z s z#FabricXMLRPCConnection.is_connected)rs rt ru rv r� r? r@ r@ rB rz r� rV r6 r r� r> r> r� r? rx 2 s � -rx c sT e Zd ZdZed eef� fdd� Zedd� �Z dd� Z d d � Z ed d � �Z � Z S ) r4 zT Class holding a connection to a MySQL Fabric server through MySQL protocol r$ c s$ t t| �j|||||d� d| _dS )r� )r; r< r= N)r� r4 r@ � _connectionr7 r� r> r? r@ � s �z FabricMySQLConnection.__init__c C s | j S )z*Returns the MySQL RPC Connection to Fabric)rW rV r> r> r? r\ � s z FabricMySQLConnection.connectionc C s� | j r | jS | j}| j}d}||kr�|d7 }zZ| j| j| jj| jjd�}| jj r|t s\t d��| jj d |d< | jj d |d< t f |�W S t k r� } z4||kr�t d �|���t�d j| j| j|d �� W 5 d }~X Y nX |dkr t�|� q d S ) z�Return the connection instance to MySQL Fabric through MySQL RPC This method tries to get a valid connection to a MySQL Fabric server. Returns a MySQLConnection instance. r r )r: r; r� r� r� r* r� r� r� rN rO rP N)r rW r� r� rF rG rE r� r� r� r� r r r{ rG r� r� r: r; rS rT )r8 r/ rU rQ �dbconfigrq r> r> r? �_get_connection� sB � � ��z%FabricMySQLConnection._get_connectionc C s | � � | _dS rH )rY rW rV r> r> r? r6 � s z FabricMySQLConnection.connectc C s( z | j �� W S tk r" Y dS X dS )rI FN)rW r r{ rV r> r> r? r � s z"FabricMySQLConnection.is_connected)rs rt ru rv r� r? r@ r@ rB r\ rY r6 r r� r> r> r� r? r4 � s � +r4 c @ s� e Zd ZdZdd� Zdd� Zedd� �Zedd � �Zd'd d �Z d d� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd� ZeZd(dd �Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd S ))�MySQLFabricConnectionz1Connection to a MySQL server through MySQL Fabricc K sJ d| _ d| _d| _d| _i | _| �� d|kr6td��|rF| jf |� dS )r� Nr9 z+Configuration parameters for Fabric missing)� _mysql_cnxrE �_fabric_mysql_server� _mysql_config�_cnx_properties�reset_propertiesr| � store_config)r8 rf r> r> r? r@ � s z MySQLFabricConnection.__init__c C s& |� d�rtdj|d���t| j|�S )z7Return the return value of the MySQLConnection instanceZcmd_zHCalling {attr} is not supported for connections managed by MySQL Fabric.)�attr)� startswithr rG ry r[ )r8 ra r> r> r? � __getattr__� s ��z!MySQLFabricConnection.__getattr__c C s | j r| j jS dS )z+Returns the Fabric UUID of the MySQL serverN)r\ r� rV r> r> r? r� � s z!MySQLFabricConnection.fabric_uuidc C s | j S )z Returns connection properties)r^ rV r> r> r? � properties s z MySQLFabricConnection.propertiesNc C s$ |s| j r| j j}| jj|d� dS )z'Reset cache for this connection's groupr N)r\ r) rE r r r> r> r? r s z!MySQLFabricConnection.reset_cachec C s | j dk S )z\Check whether we are connected with the MySQL server Returns True or False N)r[ rV r> r> r? r s z"MySQLFabricConnection.is_connectedc C s* i | _ t�� D ]\}}|d | j |< qdS )z�Resets the connection properties This method can be called to reset the connection properties to their default values. r N)r^ �_CNX_PROPERTIESrB )r8 r* ra r> r> r? r_ s z&MySQLFabricConnection.reset_propertiesc K sB z | � � W n tk r Y nX | j}|�� D �] \}}|tkrRtd�|���nD|r�t|t| d �s�d�dd� t| d D ��}t dj||d���|dkr�|r�|d s�|d r�td ��n\|d kr�|r�|d r�td ��n>|dkr�|t t fkr�td��n |dk�r|t t fk�rtd��|dk�r4t| d ||< q0|||< q0dS )at Set one or more connection properties Arguments to the set_property() method will be used as properties. They are validated against the _CNX_PROPERTIES constant. Raise ValueError in case an invalid property is being set. TypeError is raised when the type of the value is not correct. To unset a property, set it to None. z Invalid property connection {0}r z or c S s g | ] }|j �qS r> )rs )rT Zatyper> r> r? rW 6 s z6MySQLFabricConnection.set_property.<locals>.<listcomp>z({name} is not valid, excepted {typename})�name�typenamer) r* r+ z>'group' property can not be set when 'key' or 'tables' are set)r* r+ z@'key' and 'tables' property can not be set together with 'group'r. zInvalid value for 'scope'r, zInvalid value for 'mode'Nr )�closer r^ rB re r| rG r� rd r rC � SCOPE_GLOBALr# � MODE_READONLY)r8 rd �propsrf rO Zvalid_types_strr> r> r? � set_property sT �� �� ���� � z"MySQLFabricConnection.set_propertyc C s� t |t�r|| _n�dg}|D ] }||kr tdj|d���q |d }|�dt�}z|�dt| �}W n" tk r� t d�|���Y nX t ||�}zt | | _W n> tk r� t � d� tf |�| _| j�� | jt |< Y nX dS ) z�Configure the Fabric connection The config argument can be either a dictionary containing the necessary information to setup the connection. Or config can be an instance of Fabric. r: z8Missing configuration parameter '{parameter}' for fabric)Z parameterr� r; z {0} protocol is not availablezNew Fabric connectionN)r� r� rE r| rG �getrA r� r; r r� �FABRICSr� r� r )r8 �configZ required_keysZ required_keyr: r� r; r r> r> r? �_configure_fabricP s4 �� � z'MySQLFabricConnection._configure_fabricc K s� |� � }d|kr$| �|d � |d= d|kr>t�d� d|d< |� � }d|krT|d= d|krb|d= d|krp|d= z"ttt�� �d�}|jf |� W n0 t k r� } zt d � |���W 5 d}~X Y nX || _ dS ) a� Store configuration of MySQL connections to use with Fabric The configuration found in the dictionary kwargs is used when instanciating a MySQLConnection object. The host and port entries are used to connect to MySQL Fabric. Raises ValueError when the Fabric configuration parameter is not correct or missing; AttributeError is raised when when a paramater is not valid. r9 Z unix_socketz'MySQL Fabric does not use UNIX sockets.N� pool_nameZ pool_sizeZpool_reset_session)rq z'Connection configuration not valid: {0}) �copyrp r� �warningr rH r� r Z set_configr{ rG r] )r8 rf ro Z test_config�poolrQ r> r> r? r` q s, �z"MySQLFabricConnection.store_configc C s� | � � r dS | j}|d }|d }| j�� }d}||k�r�|d7 }z�d}|d r�|d dkrl|d sltd ��| jj|d |d |d |d d �}n.|d r�|d }| jj||d d�}ntd��W nx tk �r: } zXt � d� ||�� ||kr�td� |���|dk�r"t � d� |�� t � |� W Y �q0W 5 d}~X Y nX |j|d< |j|d< ztjjf |�| _W nv tk �r� } zV||k�r�| �|j� | j�|j|j� td� |���|dk�r�t � |� W Y �q0W 5 d}~X Y q0X || _�q�q0dS )a� Get a MySQL server based on properties and connect This method gets a MySQL server from MySQL Fabric using already properties set using the set_property() method. You can specify how many times and the delay between trying using attempts and attempt_delay. Raises ValueError when there are problems with arguments or properties; InterfaceError on connectivity errors. Nr/ r0 r r r+ r. r' r* z*Scope 'LOCAL' needs key property to be setr, )r. r, r) r3 z*Missing group or key and tables propertiesz-Trying to get MySQL server (attempt {0}; {1})z Error getting connection: {0}z Waiting {0}r: r; z&Reported faulty server to Fabric ({0}))r r^ r] rr r| rE r> r& r r� r� rG rS rT r: r; r$ rJ r6 r[ r r r) r r� r r\ ) r8 rk r/ r0 rX rQ r) r rq r> r> r? �_connect� s| � � �� ��� � z MySQLFabricConnection._connectc C sX zDz| �� | j �� W n( tk r, Y n tk r@ � Y nX W 5 d| _ d| _X dS )z Close connection to MySQL serverN)r[ r\ �rollbackrh r{ r rV r> r> r? � disconnect� s z MySQLFabricConnection.disconnectc C s� | � � |rtd��|r td��| jdkr2td��|p:| j}|pD| j}d}|dkrZ|dO }|dkrj|dO }tttt f}|| | �S )ai Instantiates and returns a cursor This method is similar to MySQLConnection.cursor() except that it checks whether the connection is available and raises an InterfaceError when not. cursor_class argument is not supported and will raise a NotSupportedError exception. Returns a MySQLCursor or subclass. z.Custom cursors not supported with MySQL Fabricz7Prepared Statements are not supported with MySQL FabricTzUnread result found.r r r ) ru r Z_unread_resultr Z _buffered�_rawr r r r )r8 �buffered�raw�preparedZ cursor_classZ cursor_type�typesr> r> r? r] � s0 �� �z MySQLFabricConnection.cursorc C s6 |j tkr.| �� | �� tdjt|�d���|�dS )z�Handles MySQL errors This method takes a mysql.connector.errors.Error exception and checks the error code. Based on the value, it takes certain actions such as clearing the cache. z,Temporary error ({error}); retry transactionr) N)r �RESET_CACHE_ON_ERRORr rw r rG rH �r8 rq r> r> r? �handle_mysql_error s ��z(MySQLFabricConnection.handle_mysql_errorc C s@ z| j �� W n, tk r: } z| �|� W 5 d}~X Y nX dS )z�Commit current transaction Raises whatever MySQLConnection.commit() raises, but raises MySQLFabricError when MySQL returns error ER_OPTION_PREVENTS_STATEMENT. N)r[ �commitr r r~ r> r> r? r� # s z MySQLFabricConnection.commitc C s@ z| j �� W n, tk r: } z| �|� W 5 d}~X Y nX dS )z�Rollback current transaction Raises whatever MySQLConnection.rollback() raises, but raises MySQLFabricError when MySQL returns error ER_OPTION_PREVENTS_STATEMENT. N)r[ rv r r r~ r> r> r? rv / s z MySQLFabricConnection.rollbackc C sH | � � z| j�|�W S tk rB } z| �|� W 5 d}~X Y nX dS )z�Send a statement to the MySQL server Raises whatever MySQLConnection.cmd_query() raises, but raises MySQLFabricError when MySQL returns error ER_OPTION_PREVENTS_STATEMENT. Returns a dictionary. N)ru r[ � cmd_queryr r )r8 Z statementrq r> r> r? r� ; s z MySQLFabricConnection.cmd_queryc C sH | � � z| j�|�W S tk rB } z| �|� W 5 d}~X Y nX dS )z�Send one or more statements to the MySQL server Raises whatever MySQLConnection.cmd_query_iter() raises, but raises MySQLFabricError when MySQL returns error ER_OPTION_PREVENTS_STATEMENT. Returns a dictionary. N)ru r[ �cmd_query_iterr r )r8 Z statementsrq r> r> r? r� J s z$MySQLFabricConnection.cmd_query_iter)N)NNNN)rs rt ru rv r@ rc rB r� rd r r r_ rl rp r` ru rw rh r] r r� rv r� r� r> r> r> r? rZ � s, 3!'D ) rZ )rrv �sysr9 rS r� �base64r r �hashlibr �loggingrm r� � xmlrpclibr r r r� �httplibr � ImportError� xmlrpc.client�urllib.requestr� � http.client� version_infor r� Zmysql.connectorr$ r\ r � conversionr Zpoolingr rK r r r r r r r] r r r r r( r r r Zcachingr Z balancingr r Zcatch23r r! r" ZCR_SERVER_LOSTZ ER_OPTION_PREVENTS_STATEMENTr} ZCR_SERVER_GONE_ERRORZCR_CONN_HOST_ERRORZCR_CONNECTION_ERRORZCR_IPSOCK_ERRORr r� rA r� rn r@ r? Z_GETCNX_ATTEMPT_DELAYZ_GETCNX_ATTEMPT_MAXrj r" r# Z STATUS_FAULTYZ STATUS_SPAREr r! ri rC Z_SERVER_STATUS_FAULTYrH rX r� r: rA re � getLoggerr� �objectr1 rw r rl r� r} r� r� r� r� r� r� r� r� rD rx r4 rZ r> r> r> r? �<module> s� ��� �� � ���� \#!# N R6[Q