관리-도구
편집 파일: html5parser.cpython-38.pyc
U ��.e�� � @ s d dl mZmZmZ d dlmZmZ d dlZd dlm Z ddl m Z ddl m Z ddl m Z dd lmZ dd l mZ dd lmZmZmZmZmZmZmZmZmZmZm Z m Z m Z m Z m!Z!m"Z" d!dd�Z#d"dd�Z$dd� Z%G dd� de&�Z'ej(dd� �Z)dd� Z*d#d d �Z+G d d � d e,�Z-dS )$� )�absolute_import�division�unicode_literals)�with_metaclass�viewkeysN)� OrderedDict� )� _inputstream)� _tokenizer)� treebuilders)�Marker)�_utils)�spaceCharacters�asciiUpper2Lower�specialElements�headingElements� cdataElements�rcdataElements� tokenTypes� tagTokenTypes� namespaces� htmlIntegrationPointElements�"mathmlTextIntegrationPointElements�adjustForeignAttributes�adjustMathMLAttributes�adjustSVGAttributes�E�_ReparseException�etreeTc K s$ t �|�}t||d�}|j| f|�S )a� Parse an HTML document as a string or file-like object into a tree :arg doc: the document to parse as a string or file-like object :arg treebuilder: the treebuilder to use when parsing :arg namespaceHTMLElements: whether or not to namespace HTML elements :returns: parsed tree Example: >>> from html5lib.html5parser import parse >>> parse('<html><body><p>This is a doc</p></body></html>') <Element u'{http://www.w3.org/1999/xhtml}html' at 0x7feac4909db0> ��namespaceHTMLElements)r �getTreeBuilder� HTMLParser�parse)�doc� treebuilderr �kwargs�tb�p� r) �D/usr/lib/python3.8/site-packages/pip/_vendor/html5lib/html5parser.pyr# s r# �divc K s, t �|�}t||d�}|j| fd|i|��S )a# Parse an HTML fragment as a string or file-like object into a tree :arg doc: the fragment to parse as a string or file-like object :arg container: the container context to parse the fragment in :arg treebuilder: the treebuilder to use when parsing :arg namespaceHTMLElements: whether or not to namespace HTML elements :returns: parsed tree Example: >>> from html5lib.html5libparser import parseFragment >>> parseFragment('<b>this is a fragment</b>') <Element u'DOCUMENT_FRAGMENT' at 0x7feac484b090> r � container)r r! r" � parseFragment)r$ r, r% r r& r' r( r) r) r* r- 2 s r- c s G � fdd�dt �}|S )Nc s e Zd Z� fdd�ZdS )z-method_decorator_metaclass.<locals>.Decoratedc s> |� � D ]$\}}t|tj�r$� |�}|||< qt�| |||�S �N)�items� isinstance�types� FunctionType�type�__new__)�metaZ classname�basesZ classDictZ attributeNameZ attribute��functionr) r* r4 M s z5method_decorator_metaclass.<locals>.Decorated.__new__N)�__name__� __module__� __qualname__r4 r) r7 r) r* � DecoratedL s r< )r3 )r8 r< r) r7 r* �method_decorator_metaclassK s r= c @ s� e Zd ZdZd+dd�Zd,dd �Zd d � Zed d � �Zdd� Z dd� Z dd� Z dd� Z dd� Z dd� Zd-dd �Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� ZdS ).r" z]HTML parser Generates a tree structure from a stream of (possibly malformed) HTML. NFTc sL |� _ |dkrt�d�}||�� _g � _t� fdd�t|��� D ��� _dS )a� :arg tree: a treebuilder class controlling the type of tree that will be returned. Built in treebuilders can be accessed through html5lib.treebuilders.getTreeBuilder(treeType) :arg strict: raise an exception when a parse error is encountered :arg namespaceHTMLElements: whether or not to namespace HTML elements :arg debug: whether or not to enable debug mode which logs things Example: >>> from html5lib.html5parser import HTMLParser >>> parser = HTMLParser() # generates parser with etree builder >>> parser = HTMLParser('lxml', strict=True) # generates parser with lxml builder which is strict Nr c s g | ]\}}||� � j �f�qS r) )�tree)�.0�name�cls��selfr) r* � <listcomp>z s z'HTMLParser.__init__.<locals>.<listcomp>) �strictr r! r> �errors�dict� getPhasesr/ �phases)rC r> rE r �debugr) rB r* �__init__^ s �zHTMLParser.__init__r+ c K sh || _ || _|| _tj|fd| i|��| _| �� z | �� W n$ tk rb | �� | �� Y nX d S )N�parser) � innerHTMLModer, � scriptingr Z HTMLTokenizer� tokenizer�reset�mainLoopr )rC �stream� innerHTMLr, rN r& r) r) r* �_parse} s zHTMLParser._parsec C s� | j �� d| _g | _g | _d| _| jr�| j�� | _ | j t krL| j j | j _ n0| j tkrd| j j| j _ n| j dkr|| j j| j _ n | jd | _| j�� | �� nd| _ | jd | _d | _d | _d| _d S )NFz no quirks� plaintext� beforeHtml�initialT)r> rP � firstStartTagrF �log� compatModerM r, �lowerrS r rO � rcdataState�stater � rawtextState�plaintextStaterI �phase�insertHtmlElement�resetInsertionModeZ lastPhaseZbeforeRCDataPhase� framesetOKrB r) r) r* rP � s* zHTMLParser.resetc C s t | d�sdS | jjjd jS )z�Name of the character encoding that was used to decode the input stream, or :obj:`None` if that is not determined yet rO Nr )�hasattrrO rR � charEncodingr@ rB r) r) r* �documentEncoding� s zHTMLParser.documentEncodingc C sJ |j dkr6|jtd kr6d|jko4|jd �t�dkS |j|j ftkS d S )N�annotation-xml�mathml�encoding)z text/htmlzapplication/xhtml+xml)r@ � namespacer � attributes� translater r �rC �elementr) r) r* �isHTMLIntegrationPoint� s � ���z!HTMLParser.isHTMLIntegrationPointc C s |j |jftkS r. )rj r@ r rm r) r) r* � isMathMLTextIntegrationPoint� s z'HTMLParser.isMathMLTextIntegrationPointc C sh t d }t d }t d }t d }t d }t d }t d }| �� D �]�}d } |} | d k �r�| } | jjrp| jjd nd } | r~| jnd } | r�| jnd } | d }||kr�| �| d | �d i �� d } qNt| jj�d k�sd| | jj k�sd| � | ��r||k�r |d t ddg�k�sd|||fk�sd| t d k�rH| dk�rH||k�rH|d dk�sd| � | ��rl||||fk�rl| j}n | jd }||k�r�|�| �} qN||k�r�|�| �} qN||k�r�|�| �} qN||k�r�|�| �} qN||k�r�|�| �} qN||krN|�| �} qN||kr@| d r@| d s@| �dd | d i� q@d}g }|�rd|�| j� | j�� }|�r.| j|k�s.t��q.d S )N� CharactersZSpaceCharacters�StartTag�EndTag�CommentZDoctype� ParseError���r3 �data�datavarsr r@ ZmglyphZ malignmarkrh rg �svg�inForeignContent� selfClosing�selfClosingAcknowledgedz&non-void-element-with-trailing-solidusT)r �normalizedTokensr> � openElementsrj r@ � parseError�get�len�defaultNamespacerp � frozensetr ro r` rI �processCharacters�processSpaceCharacters�processStartTag� processEndTag�processComment�processDoctype�append� processEOF�AssertionError)rC ZCharactersTokenZSpaceCharactersTokenZ StartTagTokenZ EndTagTokenZ CommentTokenZ DoctypeTokenZParseErrorToken�tokenZ prev_token� new_token� currentNodeZcurrentNodeNamespaceZcurrentNodeNamer3 r` Z reprocessrI r) r) r* rQ � s� ���� � ��� � � � � � zHTMLParser.mainLoopc c s | j D ]}| �|�V qd S r. )rO �normalizeToken�rC r� r) r) r* r} s zHTMLParser.normalizedTokensc O s | j |ddf|�|� | j�� S )a� Parse a HTML document into a well-formed tree :arg stream: a file-like object or string containing the HTML to be parsed The optional encoding parameter must be a string that indicates the encoding. If specified, that encoding will be used, regardless of any BOM or later declaration (such as in a meta element). :arg scripting: treat noscript elements as if JavaScript was turned on :returns: parsed tree Example: >>> from html5lib.html5parser import HTMLParser >>> parser = HTMLParser() >>> parser.parse('<html><body><p>This is a doc</p></body></html>') <Element u'{http://www.w3.org/1999/xhtml}html' at 0x7feac4909db0> FN)rT r> Z getDocument�rC rR �argsr& r) r) r* r# s zHTMLParser.parsec O s | j |df|�|� | j�� S )aZ Parse a HTML fragment into a well-formed tree fragment :arg container: name of the element we're setting the innerHTML property if set to None, default to 'div' :arg stream: a file-like object or string containing the HTML to be parsed The optional encoding parameter must be a string that indicates the encoding. If specified, that encoding will be used, regardless of any BOM or later declaration (such as in a meta element) :arg scripting: treat noscript elements as if JavaScript was turned on :returns: parsed tree Example: >>> from html5lib.html5libparser import HTMLParser >>> parser = HTMLParser() >>> parser.parseFragment('<b>this is a fragment</b>') <Element u'DOCUMENT_FRAGMENT' at 0x7feac484b090> T)rT r> Z getFragmentr� r) r) r* r- $ s zHTMLParser.parseFragment�XXX-undefined-errorc C s@ |d kr i }| j �| jj�� ||f� | jr<tt| | ��d S r. )rF r� rO rR ZpositionrE ru r )rC Z errorcoderx r) r) r* r @ s zHTMLParser.parseErrorc C sT |d t d krP|d }t|�|d< t|�t|d �krP|d �|d d d� � |S )Nr3 rr rw rv )r r r� �update)rC r� �rawr) r) r* r� H s zHTMLParser.normalizeTokenc C s t |t� d S r. )�adjust_attributesr r� r) r) r* r S s z!HTMLParser.adjustMathMLAttributesc C s t |t� d S r. )r� r r� r) r) r* r V s z HTMLParser.adjustSVGAttributesc C s t |t� d S r. )r� �adjustForeignAttributesMapr� r) r) r* r Y s z"HTMLParser.adjustForeignAttributesc C s | j �� d S r. )rL r` r� r) r) r* �reparseTokenNormal\ s z HTMLParser.reparseTokenNormalc C s� d}ddddddddddd d d d d �}| j jd d d � D ]�}|j}d }|| j jd krj| js`t�d}| j}|dkr|| js|t�|s�|j| j jkr�q8||kr�| j|| } q�q8|r8| jd } q�q8|| _d S )NF�inSelect�inCell�inRow� inTableBody� inCaption� inColumnGroup�inTable�inBody� inFrameset� beforeHead)�select�td�th�tr�tbody�thead�tfoot�caption�colgroup�table�head�body�frameset�htmlrv r T)r� r� r� r� ) r> r~ r@ rS r� rj r� rI r` )rC ZlastZnewModes�nodeZnodeNameZ new_phaser) r) r* rb ` sD � z HTMLParser.resetInsertionModec C sR |dks t �| j�|� |dkr.| jj| j_n | jj| j_| j| _| j d | _d S )N)�RAWTEXT�RCDATAr� �text) r� r> � insertElementrO r^ r] r\ r` � originalPhaserI )rC r� Z contentTyper) r) r* �parseRCDataRawtext� s z HTMLParser.parseRCDataRawtext)NFTF)Fr+ F)r� N)r9 r: r; �__doc__rK rT rP �propertyrf ro rp rQ r} r# r- r r� r r r r� rb r� r) r) r) r* r" W s( " C ,r" c s" dd� }dd� }G dd� dt || |���� G dd� d� �}G d d � d � �}G � fd d �d � �}G � fd d�d� �}G � fdd�d� �}G � fdd�d� �}G � fdd�d� �} G � fdd�d� �} G � fdd�d� �} G � fdd�d� �} G � fdd �d � �} G � fd d �d � �}G � fd d �d � �}G � fd!d"�d"� �}G � fd#d$�d$� �}G � fd%d&�d&� �}G � fd'd(�d(� �}G � fd)d*�d*� �}G � fd+d,�d,� �}G � fd-d.�d.� �}G � fd/d0�d0� �}G � fd1d2�d2� �}G � fd3d4�d4� �}||||||| | | | | ||||||||||||d5�S )6Nc s( t dd� t�� D ���� �fdd�}|S )z4Logger that records which phase processes each tokenc s s | ]\}}||fV qd S r. r) )r? �key�valuer) r) r* � <genexpr>� s z)getPhases.<locals>.log.<locals>.<genexpr>c s� � j �d�r�t|�dkr�|d }zd�|d i}W n � Y nX |d tkr\|d |d< | jj�| jjjj | jj j j | j j � j |f� � | f|�|�S � | f|�|�S d S )NZprocessr r3 r@ ) r9 � startswithr� r rL rY r� rO r] r` � __class__)rC r� r& r� �info�r8 Z type_namesr) r* �wrapped� s �z'getPhases.<locals>.log.<locals>.wrapped)rG r r/ )r8 r� r) r� r* rY � s �zgetPhases.<locals>.logc S s | r t |�S tS d S r. )r= r3 )Z use_metaclassZmetaclass_funcr) r) r* � getMetaclass� s z getPhases.<locals>.getMetaclassc @ sX e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z dd� Z dS )zgetPhases.<locals>.PhasezNBase class for helper object that implements each phase of processing c S s || _ || _d S r. )rL r> �rC rL r> r) r) r* rK � s z!getPhases.<locals>.Phase.__init__c S s t �d S r. )�NotImplementedErrorrB r) r) r* r� � s z#getPhases.<locals>.Phase.processEOFc S s | j �|| j jd � d S )Nrv �r> � insertCommentr~ r� r) r) r* r� � s z'getPhases.<locals>.Phase.processCommentc S s | j �d� d S )Nzunexpected-doctype�rL r r� r) r) r* r� � s z'getPhases.<locals>.Phase.processDoctypec S s | j �|d � d S �Nrw �r> � insertTextr� r) r) r* r� � s z*getPhases.<locals>.Phase.processCharactersc S s | j �|d � d S r� r� r� r) r) r* r� � s z/getPhases.<locals>.Phase.processSpaceCharactersc S s | j |d |�S �Nr@ )�startTagHandlerr� r) r) r* r� � s z(getPhases.<locals>.Phase.processStartTagc S sf | j js |d dkr | j �d� |d �� D ],\}}|| jjd jkr,|| jjd j|< q,d| j _d S )Nr@ r� z non-html-rootrw r F)rL rX r r/ r> r~ rk �rC r� �attrr� r) r) r* � startTagHtml� s z%getPhases.<locals>.Phase.startTagHtmlc S s | j |d |�S r� )� endTagHandlerr� r) r) r* r� � s z&getPhases.<locals>.Phase.processEndTagN) r9 r: r; r� rK r� r� r� r� r� r� r� r� r) r) r) r* �Phase� s r� c @ sL e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dS )z getPhases.<locals>.InitialPhasec S s d S r. r) r� r) r) r* r� � s z6getPhases.<locals>.InitialPhase.processSpaceCharactersc S s | j �|| j j� d S r. �r> r� Zdocumentr� r) r) r* r� � s z.getPhases.<locals>.InitialPhase.processCommentc S s� |d }|d }|d }|d }|dks@|d k s@|d k rL|dkrL| j �d� |d krXd}| j�|� |dkrv|�t�}|r�|d dks�|�d �s�|d ks�|�d �r�|d ks�|r�|�� d kr�d | j _n$|�d�s�|�d �r�|d k r�d| j _| j j d | j _ d S )Nr@ �publicId�systemId�correctr� zabout:legacy-compatzunknown-doctype� )7z*+//silmaril//dtd html pro v0r11 19970101//z4-//advasoft ltd//dtd html 3.0 aswedit + extensions//z*-//as//dtd html 3.0 aswedit + extensions//z -//ietf//dtd html 2.0 level 1//z -//ietf//dtd html 2.0 level 2//z&-//ietf//dtd html 2.0 strict level 1//z&-//ietf//dtd html 2.0 strict level 2//z -//ietf//dtd html 2.0 strict//z-//ietf//dtd html 2.0//z-//ietf//dtd html 2.1e//z-//ietf//dtd html 3.0//z -//ietf//dtd html 3.2 final//z-//ietf//dtd html 3.2//z-//ietf//dtd html 3//z-//ietf//dtd html level 0//z-//ietf//dtd html level 1//z-//ietf//dtd html level 2//z-//ietf//dtd html level 3//z"-//ietf//dtd html strict level 0//z"-//ietf//dtd html strict level 1//z"-//ietf//dtd html strict level 2//z"-//ietf//dtd html strict level 3//z-//ietf//dtd html strict//z-//ietf//dtd html//z(-//metrius//dtd metrius presentational//z5-//microsoft//dtd internet explorer 2.0 html strict//z.-//microsoft//dtd internet explorer 2.0 html//z0-//microsoft//dtd internet explorer 2.0 tables//z5-//microsoft//dtd internet explorer 3.0 html strict//z.-//microsoft//dtd internet explorer 3.0 html//z0-//microsoft//dtd internet explorer 3.0 tables//z#-//netscape comm. corp.//dtd html//z*-//netscape comm. corp.//dtd strict html//z*-//o'reilly and associates//dtd html 2.0//z3-//o'reilly and associates//dtd html extended 1.0//z;-//o'reilly and associates//dtd html extended relaxed 1.0//zN-//softquad software//dtd hotmetal pro 6.0::19990601::extensions to html 4.0//zE-//softquad//dtd hotmetal pro 4.0::19971010::extensions to html 4.0//z$-//spyglass//dtd html 2.0 extended//z+-//sq//dtd html 2.0 hotmetal + extensions//z--//sun microsystems corp.//dtd hotjava html//z4-//sun microsystems corp.//dtd hotjava strict html//z -//w3c//dtd html 3 1995-03-24//z -//w3c//dtd html 3.2 draft//z -//w3c//dtd html 3.2 final//z-//w3c//dtd html 3.2//z -//w3c//dtd html 3.2s draft//z -//w3c//dtd html 4.0 frameset//z#-//w3c//dtd html 4.0 transitional//z(-//w3c//dtd html experimental 19960712//z&-//w3c//dtd html experimental 970421//z-//w3c//dtd w3 html//z-//w3o//dtd w3 html 3.0//z#-//webtechs//dtd mozilla html 2.0//z -//webtechs//dtd mozilla html//)z$-//w3o//dtd w3 html strict 3.0//en//z"-/w3c/dtd html 4.0 transitional/enr� )z -//w3c//dtd html 4.01 frameset//z$-//w3c//dtd html 4.01 transitional//z:http://www.ibm.com/data/dtd/v11/ibmxhtml1-transitional.dtd�quirks)z -//w3c//dtd xhtml 1.0 frameset//z$-//w3c//dtd xhtml 1.0 transitional//zlimited quirksrV ) rL r r> Z insertDoctyperl r r� r[ rZ rI r` )rC r� r@ r� r� r� r) r) r* r� � sX �� ��9�<��?�@�@ �A ����z.getPhases.<locals>.InitialPhase.processDoctypec S s d| j _| j jd | j _d S )Nr� rV )rL rZ rI r` rB r) r) r* � anythingElseM s z,getPhases.<locals>.InitialPhase.anythingElsec S s | j �d� | �� |S )Nz expected-doctype-but-got-chars�rL r r� r� r) r) r* r� Q s z1getPhases.<locals>.InitialPhase.processCharactersc S s" | j �dd|d i� | �� |S )Nz"expected-doctype-but-got-start-tagr@ r� r� r) r) r* r� V s �z/getPhases.<locals>.InitialPhase.processStartTagc S s" | j �dd|d i� | �� |S )Nz expected-doctype-but-got-end-tagr@ r� r� r) r) r* r� \ s �z-getPhases.<locals>.InitialPhase.processEndTagc S s | j �d� | �� dS )Nz expected-doctype-but-got-eofTr� rB r) r) r* r� b s z*getPhases.<locals>.InitialPhase.processEOFN) r9 r: r; r� r� r� r� r� r� r� r� r) r) r) r* � InitialPhase� s _r� c @ sD e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dS )z"getPhases.<locals>.BeforeHtmlPhasec S s& | j �tdd�� | jjd | j_d S )Nr� rr r� )r> Z insertRoot�impliedTagTokenrL rI r` rB r) r) r* ra i s z4getPhases.<locals>.BeforeHtmlPhase.insertHtmlElementc S s | � � dS �NT�ra rB r) r) r* r� n s z-getPhases.<locals>.BeforeHtmlPhase.processEOFc S s | j �|| j j� d S r. r� r� r) r) r* r� r s z1getPhases.<locals>.BeforeHtmlPhase.processCommentc S s d S r. r) r� r) r) r* r� u s z9getPhases.<locals>.BeforeHtmlPhase.processSpaceCharactersc S s | � � |S r. r� r� r) r) r* r� x s z4getPhases.<locals>.BeforeHtmlPhase.processCharactersc S s |d dkrd| j _| �� |S )Nr@ r� T)rL rX ra r� r) r) r* r� | s z2getPhases.<locals>.BeforeHtmlPhase.processStartTagc S s4 |d dkr$| j �dd|d i� n | �� |S d S )Nr@ �r� r� r� �brz unexpected-end-tag-before-html)rL r ra r� r) r) r* r� � s �z0getPhases.<locals>.BeforeHtmlPhase.processEndTagN) r9 r: r; ra r� r� r� r� r� r� r) r) r) r* �BeforeHtmlPhaseg s r� c sX e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dS )z"getPhases.<locals>.BeforeHeadPhasec sV � � | ||� t�d| jfd| jfg�| _| j| j_t�d| jfg�| _ | j | j _d S )Nr� r� r� ) rK r �MethodDispatcherr� � startTagHeadr� � startTagOther�default�endTagImplyHeadr� � endTagOtherr� �r� r) r* rK � s � �z+getPhases.<locals>.BeforeHeadPhase.__init__c S s | � tdd�� dS )Nr� rr T�r� r� rB r) r) r* r� � s z-getPhases.<locals>.BeforeHeadPhase.processEOFc S s d S r. r) r� r) r) r* r� � s z9getPhases.<locals>.BeforeHeadPhase.processSpaceCharactersc S s | � tdd�� |S �Nr� rr r� r� r) r) r* r� � s z4getPhases.<locals>.BeforeHeadPhase.processCharactersc S s | j jd �|�S �Nr� �rL rI r� r� r) r) r* r� � s z/getPhases.<locals>.BeforeHeadPhase.startTagHtmlc S s0 | j �|� | j jd | j _| jjd | j_d S )Nrv �inHead)r> r� r~ � headPointerrL rI r` r� r) r) r* r� � s z/getPhases.<locals>.BeforeHeadPhase.startTagHeadc S s | � tdd�� |S r� r� r� r) r) r* r� � s z0getPhases.<locals>.BeforeHeadPhase.startTagOtherc S s | � tdd�� |S r� r� r� r) r) r* r� � s z2getPhases.<locals>.BeforeHeadPhase.endTagImplyHeadc S s | j �dd|d i� d S )Nzend-tag-after-implied-rootr@ r� r� r) r) r* r� � s �z.getPhases.<locals>.BeforeHeadPhase.endTagOtherN) r9 r: r; rK r� r� r� r� r� r� r� r� r) r� r) r* �BeforeHeadPhase� s r� c s� e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!S )"z getPhases.<locals>.InHeadPhasec s� � � | ||� t�d| jfd| jfd| jfd| jfd| jfd| jfd| j fd| j fg�| _ | j | j _ t�d| jfd | jfg�| _| j| j_ d S ) Nr� �title)�noframes�style�noscript�script)�base�basefont�bgsound�command�linkr5 r� )r� r� r� )rK r r� r� � startTagTitle�startTagNoFramesStyle�startTagNoscript�startTagScript�startTagBaseLinkCommand� startTagMetar� r� r� r� � endTagHead�endTagHtmlBodyBrr� r� r� r� r) r* rK � s& �� �z'getPhases.<locals>.InHeadPhase.__init__c S s | � � dS r� �r� rB r) r) r* r� � s z)getPhases.<locals>.InHeadPhase.processEOFc S s | � � |S r. r r� r) r) r* r� � s z0getPhases.<locals>.InHeadPhase.processCharactersc S s | j jd �|�S r� r� r� r) r) r* r� � s z+getPhases.<locals>.InHeadPhase.startTagHtmlc S s | j �d� d S )Nz!two-heads-are-not-better-than-oner� r� r) r) r* r� � s z+getPhases.<locals>.InHeadPhase.startTagHeadc S s$ | j �|� | j j�� d|d< d S �NTr| �r> r� r~ �popr� r) r) r* r� � s z6getPhases.<locals>.InHeadPhase.startTagBaseLinkCommandc S s� | j �|� | j j�� d|d< |d }| jjjjd dkr�d|krZ| jjj�|d � nVd|kr�d|kr�|d � � d kr�t � |d � d ��}t � |�}|�� }| jjj�|� d S ) NTr| rw r Z tentative�charsetZcontentz http-equivz content-typezutf-8)r> r� r~ r rL rO rR re ZchangeEncodingr[ r Z EncodingBytes�encodeZContentAttrParserr# )rC r� rk rw rL �codecr) r) r* r� � s �� z+getPhases.<locals>.InHeadPhase.startTagMetac S s | j �|d� d S )Nr� �rL r� r� r) r) r* r� � s z,getPhases.<locals>.InHeadPhase.startTagTitlec S s | j �|d� d S )Nr� r r� r) r) r* r� � s z4getPhases.<locals>.InHeadPhase.startTagNoFramesStylec S s8 | j jr| j �|d� n | j�|� | j jd | j _d S )Nr� �inHeadNoscript)rL rN r� r> r� rI r` r� r) r) r* r� � s z/getPhases.<locals>.InHeadPhase.startTagNoscriptc S s< | j �|� | jjj| jj_| jj| j_| jjd | j_d S )Nr� ) r> r� rL rO ZscriptDataStater] r` r� rI r� r) r) r* r� s z-getPhases.<locals>.InHeadPhase.startTagScriptc S s | � � |S r. r r� r) r) r* r� s z,getPhases.<locals>.InHeadPhase.startTagOtherc S s: | j jj�� }|jdks&td|j ��| j jd | j _d S )Nr� zExpected head got %s� afterHead�rL r> r~ r r@ r� rI r` �rC r� r� r) r) r* r s z)getPhases.<locals>.InHeadPhase.endTagHeadc S s | � � |S r. r r� r) r) r* r s z/getPhases.<locals>.InHeadPhase.endTagHtmlBodyBrc S s | j �dd|d i� d S �N�unexpected-end-tagr@ r� r� r) r) r* r� s z*getPhases.<locals>.InHeadPhase.endTagOtherc S s | � td�� d S )Nr� )r r� rB r) r) r* r� s z+getPhases.<locals>.InHeadPhase.anythingElseN)r9 r: r; rK r� r� r� r� r� r� r� r� r� r� r� r r r� r� r) r� r) r* � InHeadPhase� s r c sx e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� ZdS ) z&getPhases.<locals>.InHeadNoscriptPhasec sf � � | ||� t�d| jfd| jfd| jfg�| _| j| j_t�d| j fd| j fg�| _ | j | j _d S )Nr� )r� r� r� r5 r� r� )r� r� r� r� ) rK r r� r� r� �startTagHeadNoscriptr� r� r� �endTagNoscript�endTagBrr� r� r� r� r) r* rK s � �z/getPhases.<locals>.InHeadNoscriptPhase.__init__c S s | j �d� | �� dS )Nzeof-in-head-noscriptTr� rB r) r) r* r� 0 s z1getPhases.<locals>.InHeadNoscriptPhase.processEOFc S s | j jd �|�S �Nr� )rL rI r� r� r) r) r* r� 5 s z5getPhases.<locals>.InHeadNoscriptPhase.processCommentc S s | j �d� | �� |S )Nzchar-in-head-noscriptr� r� r) r) r* r� 8 s z8getPhases.<locals>.InHeadNoscriptPhase.processCharactersc S s | j jd �|�S r �rL rI r� r� r) r) r* r� = s z=getPhases.<locals>.InHeadNoscriptPhase.processSpaceCharactersc S s | j jd �|�S r� r� r� r) r) r* r� @ s z3getPhases.<locals>.InHeadNoscriptPhase.startTagHtmlc S s | j jd �|�S r r� r� r) r) r* r� C s z>getPhases.<locals>.InHeadNoscriptPhase.startTagBaseLinkCommandc S s | j �dd|d i� d S �N�unexpected-start-tagr@ r� r� r) r) r* r F s z;getPhases.<locals>.InHeadNoscriptPhase.startTagHeadNoscriptc S s" | j �dd|d i� | �� |S �Nz unexpected-inhead-noscript-tagr@ r� r� r) r) r* r� I s z4getPhases.<locals>.InHeadNoscriptPhase.startTagOtherc S s: | j jj�� }|jdks&td|j ��| j jd | j _d S )Nr� zExpected noscript got %sr� r r r) r) r* r N s z5getPhases.<locals>.InHeadNoscriptPhase.endTagNoscriptc S s" | j �dd|d i� | �� |S r r� r� r) r) r* r S s z/getPhases.<locals>.InHeadNoscriptPhase.endTagBrc S s | j �dd|d i� d S r r� r� r) r) r* r� X s z2getPhases.<locals>.InHeadNoscriptPhase.endTagOtherc S s | � td�� d S )Nr� )r r� rB r) r) r* r� [ s z3getPhases.<locals>.InHeadNoscriptPhase.anythingElseN)r9 r: r; rK r� r� r� r� r� r� r r� r r r� r� r) r� r) r* �InHeadNoscriptPhase s r c sp e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� ZdS )z!getPhases.<locals>.AfterHeadPhasec sn � � | ||� t�d| jfd| jfd| jfd| jfd| jfg�| _| j | j_ t�d| j fg�| _ | j | j _ d S )Nr� r� r� ) r� r� r� r� r5 r� r� r� r� r� )r� r� r� )rK r r� r� � startTagBody�startTagFrameset�startTagFromHeadr� r� r� r� r r� r� r� r� r) r* rK ` s �� � z*getPhases.<locals>.AfterHeadPhase.__init__c S s | � � dS r� r rB r) r) r* r� q s z,getPhases.<locals>.AfterHeadPhase.processEOFc S s | � � |S r. r r� r) r) r* r� u s z3getPhases.<locals>.AfterHeadPhase.processCharactersc S s | j jd �|�S r� r� r� r) r) r* r� y s z.getPhases.<locals>.AfterHeadPhase.startTagHtmlc S s( d| j _| j�|� | j jd | j _d S )NFr� )rL rc r> r� rI r` r� r) r) r* r | s z.getPhases.<locals>.AfterHeadPhase.startTagBodyc S s | j �|� | jjd | j_d S )Nr� )r> r� rL rI r` r� r) r) r* r � s z2getPhases.<locals>.AfterHeadPhase.startTagFramesetc S sr | j �dd|d i� | jj�| jj� | j jd �|� | jjd d d� D ] }|jdkrL| jj� |� qnqLd S )Nz#unexpected-start-tag-out-of-my-headr@ r� rv r� ) rL r r> r~ r� r� rI r� r@ �remover r) r) r* r � s � z2getPhases.<locals>.AfterHeadPhase.startTagFromHeadc S s | j �dd|d i� d S r r� r� r) r) r* r� � s z.getPhases.<locals>.AfterHeadPhase.startTagHeadc S s | � � |S r. r r� r) r) r* r� � s z/getPhases.<locals>.AfterHeadPhase.startTagOtherc S s | � � |S r. r r� r) r) r* r � s z2getPhases.<locals>.AfterHeadPhase.endTagHtmlBodyBrc S s | j �dd|d i� d S r r� r� r) r) r* r� � s z-getPhases.<locals>.AfterHeadPhase.endTagOtherc S s. | j �tdd�� | jjd | j_d| j_d S )Nr� rr r� T)r> r� r� rL rI r` rc rB r) r) r* r� � s z.getPhases.<locals>.AfterHeadPhase.anythingElseN)r9 r: r; rK r� r� r� r r r r� r� r r� r� r) r� r) r* �AfterHeadPhase_ s r c s� e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Z d5d6� Z d7d8� Z d9d:� Z d;d<� Z d=d>� Z!d?d@� Z"dAdB� Z#dCdD� Z$dEdF� Z%dGdH� Z&dIdJ� Z'dKdL� Z(dMdN� Z)dOdP� Z*dQdR� Z+dSdT� Z,dUdV� Z-dWdX� Z.dYdZ� Z/d[d\� Z0d]d^� Z1d_d`� Z2dadb� Z3dcdd� Z4dedf� Z5dgS )hz getPhases.<locals>.InBodyPhasec $ s� � � | ||� | j| _t�d| jfd| jfd| jfd| jfd| j ft | j fd| j fd| j fd| jfd | jfd | jfd | jfd | jfd | jfd| jfd| jfd| jfd| jfd| jfd| jfd| jfd| jfd| j fd| j fd| j fd| j fd| j fd| j!fd | j"fd | j#fd | j$fd | j%fd | j&fg!�| _'| j(| j'_)t�d| j*fd| j+fd!| j,fd| j-fd"| j.fd#| j/ft | j0fd$| j1fd| j2fd%| j3fg �| _4| j5| j4_)d S )&Nr� ) r� r� r� r� r� r5 r� r� r� r� r� )�address�article�aside� blockquote�center�details�dirr+ �dl�fieldset� figcaption�figure�footer�header�hgroup�main�menu�nav�olr( �section�summary�ul)�pre�listing�form)�li�dd�dtrU �a) �b�big�code�em�font�i�s�small�strike�strong�tt�u�nobr�button)ZappletZmarquee�objectZxmpr� )Zarear� �embed�img�keygenZwbr)Zparam�sourceZtrack�input�hr�image�isindex�textareaZiframer� )Znoembedr� r� )�rp�rt)�option�optgroupZmathry ) r� �colr� �framer� r� r� r� r� r� r� )r r r! r" rH r# r$ Zdialogr% r+ r& r' r( r) r* r+ r, r5 r- r. r/ r0 r4 r1 r2 r3 r( )r8 r9 r7 )r: r; r< r= r> r? r@ rG rA rB rC rD rE rF r� )6rK � processSpaceCharactersNonPrer� r r� r� �startTagProcessInHeadr r �startTagClosePr �startTagHeading�startTagPreListing� startTagForm�startTagListItem�startTagPlaintext� startTagA�startTagFormatting� startTagNobr�startTagButton�startTagAppletMarqueeObject� startTagXmp� startTagTable�startTagVoidFormatting�startTagParamSource� startTagInput� startTagHr� startTagImage�startTagIsIndex�startTagTextarea�startTagIFramer� �startTagRawtext�startTagSelect� startTagRpRt� startTagOpt� startTagMath� startTagSvg�startTagMisplacedr� r� r� � endTagBody� endTagHtml� endTagBlock� endTagForm�endTagP�endTagListItem� endTagHeading�endTagFormatting�endTagAppletMarqueeObjectr r� r� r� r� r) r* rK � s� ������- ���z'getPhases.<locals>.InBodyPhase.__init__c S s$ |j |j ko"|j|jko"|j|jkS r. )r@ rj rk )rC Znode1Znode2r) r) r* �isMatchingFormattingElement� s � �z:getPhases.<locals>.InBodyPhase.isMatchingFormattingElementc S s� | j �|� | j jd }g }| j jd d d� D ](}|tkr@ qXq.| �||�r.|�|� q.t|�dksht�t|�dkr�| j j� |d � | j j�|� d S )Nrv � ) r> r� r~ �activeFormattingElementsr r� r� r� r� r )rC r� rn ZmatchingElementsr� r) r) r* �addFormattingElement� s z3getPhases.<locals>.InBodyPhase.addFormattingElementc S s> t d�}| jjd d d� D ] }|j|kr| j�d� q:qd S )N) r8 r9 r7 r( r� r� r� r� r� r� r� r� rv z expected-closing-tag-but-got-eof)r� r> r~ r@ rL r )rC Zallowed_elementsr� r) r) r* r� s z)getPhases.<locals>.InBodyPhase.processEOFc S sf |d }| j | _|�d�rH| jjd jdkrH| jjd �� sH|dd � }|rb| j�� | j�|� d S )Nrw � rv )r4 r5 rR r ) rY r� r� r> r~ r@ Z hasContent�#reconstructActiveFormattingElementsr� )rC r� rw r) r) r* �!processSpaceCharactersDropNewline s �� z@getPhases.<locals>.InBodyPhase.processSpaceCharactersDropNewlinec S sT |d dkrd S | j �� | j �|d � | jjrPtdd� |d D ��rPd| j_d S )Nrw � c S s g | ] }|t k�qS r) �r �r? �charr) r) r* rD " s �zDgetPhases.<locals>.InBodyPhase.processCharacters.<locals>.<listcomp>F)r> r� r� rL rc �anyr� r) r) r* r� s ��z0getPhases.<locals>.InBodyPhase.processCharactersc S s | j �� | j �|d � d S r� )r> r� r� r� r) r) r* rY & s z;getPhases.<locals>.InBodyPhase.processSpaceCharactersNonPrec S s | j jd �|�S r r� r� r) r) r* rZ * s z4getPhases.<locals>.InBodyPhase.startTagProcessInHeadc S s� | j �dddi� t| jj�dks4| jjd jdkrB| j js�t�nBd| j _|d � � D ],\}}|| jjd j krV|| jjd j |< qVd S )Nr r@ r� r Frw ) rL r r� r> r~ r@ rS r� rc r/ rk r� r) r) r* r - s �z+getPhases.<locals>.InBodyPhase.startTagBodyc S s� | j �dddi� t| jj�dks4| jjd jdkrB| j js�t�np| j jsLnf| jjd j rv| jjd j � | jjd � | jjd jdkr�| jj� � qv| j� |� | j j d | j _d S ) Nr r@ r� r r� rv r� r� )rL r r� r> r~ r@ rS r� rc �parent� removeChildr r� rI r` r� r) r) r* r 8 s " z/getPhases.<locals>.InBodyPhase.startTagFramesetc S s. | j jddd�r | �td�� | j �|� d S �Nr( rH ��variant)r> �elementInScoper{ r� r� r� r) r) r* r[ F s z-getPhases.<locals>.InBodyPhase.startTagClosePc S s> | j jddd�r | �td�� | j �|� d| j_| j| _d S )Nr( rH r� F) r> r� r{ r� r� rL rc r� r� r� r) r) r* r] K s z1getPhases.<locals>.InBodyPhase.startTagPreListingc S sZ | j jr | j�dddi� n:| j jddd�r:| �td�� | j �|� | j jd | j _d S )Nr r@ r6 r( rH r� rv ) r> � formPointerrL r r� r{ r� r� r~ r� r) r) r* r^ R s z+getPhases.<locals>.InBodyPhase.startTagFormc S s� d| j _dgddgddgd�}||d }t| jj�D ]@}|j|kr^| j j�t|jd�� qx|j t kr6|jdkr6 qxq6| jj d d d �r�| j j�td d�� | j� |� d S ) NFr7 r9 r8 )r7 r9 r8 r@ rs )r r+ r( r( rH r� ) rL rc �reversedr> r~ r@ r` r� r� � nameTupler r� r� )rC r� Z stopNamesMapZ stopNamesr� r) r) r* r_ [ s* � � ��z/getPhases.<locals>.InBodyPhase.startTagListItemc S s> | j jddd�r | �td�� | j �|� | jjj| jj_d S r� ) r> r� r{ r� r� rL rO r_ r] r� r) r) r* r` q s z0getPhases.<locals>.InBodyPhase.startTagPlaintextc S sb | j jddd�r | �td�� | j jd jtkrR| j�dd|d i� | j j� � | j � |� d S )Nr( rH r� rv r r@ ) r> r� r{ r� r~ r@ r rL r r r� r� r) r) r* r\ w s z.getPhases.<locals>.InBodyPhase.startTagHeadingc S s~ | j �d�}|rf| j�dddd�� | �td�� || j jkrL| j j�|� || j jkrf| j j�|� | j � � | � |� d S )Nr: �$unexpected-start-tag-implies-end-tag�Z startNameZendName) r> �!elementInActiveFormattingElementsrL r r~ r� r~ r r� r� r� )rC r� Z afeAElementr) r) r* ra s � z(getPhases.<locals>.InBodyPhase.startTagAc S s | j �� | �|� d S r. )r> r� r� r� r) r) r* rb � s z1getPhases.<locals>.InBodyPhase.startTagFormattingc S sP | j �� | j �d�rB| j�dddd�� | �td�� | j �� | �|� d S )NrG r� r� )r> r� r� rL r r� r� r� r� r) r) r* rc � s � z+getPhases.<locals>.InBodyPhase.startTagNobrc S sT | j �d�r2| j�dddd�� | �td�� |S | j �� | j �|� d| j_d S )NrH r� r� F) r> r� rL r r� r� r� r� rc r� r) r) r* rd � s � z-getPhases.<locals>.InBodyPhase.startTagButtonc S s0 | j �� | j �|� | j j�t� d| j_d S �NF)r> r� r� r� r� r rL rc r� r) r) r* re � s z:getPhases.<locals>.InBodyPhase.startTagAppletMarqueeObjectc S sB | j jddd�r | �td�� | j �� d| j_| j�|d� d S )Nr( rH r� Fr� )r> r� r{ r� r� rL rc r� r� r) r) r* rf � s z*getPhases.<locals>.InBodyPhase.startTagXmpc S sR | j jdkr*| jjddd�r*| �td�� | j�|� d| j _| j jd | j _ d S )Nr� r( rH r� Fr� ) rL rZ r> r� r� r� r� rc rI r` r� r) r) r* rg � s z,getPhases.<locals>.InBodyPhase.startTagTablec S s6 | j �� | j �|� | j j�� d|d< d| j_d S )NTr| F)r> r� r� r~ r rL rc r� r) r) r* rh � s z5getPhases.<locals>.InBodyPhase.startTagVoidFormattingc S s@ | j j}| �|� d|d kr<|d d �t�dkr<|| j _d S )Nr3 rw �hidden)rL rc rh rl r )rC r� rc r) r) r* rj � s �z,getPhases.<locals>.InBodyPhase.startTagInputc S s$ | j �|� | j j�� d|d< d S r r r� r) r) r* ri � s z2getPhases.<locals>.InBodyPhase.startTagParamSourcec S sJ | j jddd�r | �td�� | j �|� | j j�� d|d< d| j_d S )Nr( rH r� Tr| F) r> r� r{ r� r� r~ r rL rc r� r) r) r* rk � s z)getPhases.<locals>.InBodyPhase.startTagHrc S s6 | j �dddd�� | �tdd|d |d d�� d S ) Nz unexpected-start-tag-treated-asrP rK �Z originalNameZnewNamerr rw r{ �rk r{ )rL r r� r� r� r) r) r* rl � s � �z,getPhases.<locals>.InBodyPhase.startTagImagec S s | j �dddi� | jjr d S i }d|d kr>|d d |d< | �tdd|d�� | �td d�� | �td d�� d |d kr�|d d }nd }| �td |d�� |d �� }d|kr�|d= d |kr�|d = d|d< | �tdd||d d�� | � td �� | �td d�� | � td�� d S )Nzdeprecated-tagr@ rQ �actionrw r6 rr )rk rO Zlabel�promptz3This is a searchable index. Enter search keywords: rq �r3 rw rN r{ r� ) rL r r> r� r� r� r� r �copyr� )rC r� Z form_attrsr� rk r) r) r* rm � s< � � �z.getPhases.<locals>.InBodyPhase.startTagIsIndexc S s0 | j �|� | jjj| jj_| j| _d| j_d S r� ) r> r� rL rO r\ r] r� r� rc r� r) r) r* rn � s z/getPhases.<locals>.InBodyPhase.startTagTextareac S s d| j _| �|� d S r� )rL rc rp r� r) r) r* ro s z-getPhases.<locals>.InBodyPhase.startTagIFramec S s" | j jr| �|� n | �|� d S r. )rL rN rp r� r� r) r) r* r� s z/getPhases.<locals>.InBodyPhase.startTagNoscriptc S s | j �|d� dS )z8iframe, noembed noframes, noscript(if scripting enabled)r� Nr r� r) r) r* rp s z.getPhases.<locals>.InBodyPhase.startTagRawtextc S s@ | j jd jdkr$| jj�td�� | j �� | jj �|� d S �Nrv rU ) r> r~ r@ rL r` r� r� r� r� r� r) r) r* rs s z*getPhases.<locals>.InBodyPhase.startTagOptc S s� | j �� | j �|� d| j_| jj| jjd | jjd | jjd | jjd | jjd | jjd fkrx| jjd | j_n| jjd | j_d S ) NFr� r� r� r� r� r� �inSelectInTabler� )r> r� r� rL rc r` rI r� r) r) r* rq s �z-getPhases.<locals>.InBodyPhase.startTagSelectc S sB | j �d�r2| j �� | j jd jdkr2| j�� | j �|� d S )N�rubyrv )r> r� �generateImpliedEndTagsr~ r@ rL r r� r� r) r) r* rr % s z+getPhases.<locals>.InBodyPhase.startTagRpRtc S sZ | j �� | j�|� | j�|� td |d< | j �|� |d rV| j j�� d|d< d S )Nrh rj r{ Tr| ) r> r� rL r r r r� r~ r r� r) r) r* rt , s z+getPhases.<locals>.InBodyPhase.startTagMathc S sZ | j �� | j�|� | j�|� td |d< | j �|� |d rV| j j�� d|d< d S )Nry rj r{ Tr| ) r> r� rL r r r r� r~ r r� r) r) r* ru 8 s z*getPhases.<locals>.InBodyPhase.startTagSvgc S s | j �dd|d i� dS )a5 Elements that should be children of other elements that have a different insertion mode; here they are ignored "caption", "col", "colgroup", "frame", "frameset", "head", "option", "optgroup", "tbody", "td", "tfoot", "th", "thead", "tr", "noscript" z unexpected-start-tag-ignoredr@ Nr� r� r) r) r* rv D s z0getPhases.<locals>.InBodyPhase.startTagMisplacedc S s | j �� | j �|� d S r. )r> r� r� r� r) r) r* r� M s z,getPhases.<locals>.InBodyPhase.startTagOtherc S s� | j jddd�sD| �tdd�� | j�dddi� | �tdd�� nT| j �d� | j jd j dkrt| j�dddi� | j j� � }|j dkr�| j j� � }q�d S ) Nr( rH r� rr r r@ rs rv ) r> r� r[ r� rL r r{ r� r~ r@ r r r) r) r* r{ Q s z&getPhases.<locals>.InBodyPhase.endTagPc S s~ | j �d�s| j�� d S | j jd jdkrj| j jdd � D ],}|jtd�kr<| j�dd|jd�� qjq<| jjd | j_d S )Nr� rv � )r8 r9 r7 rV rU r( rS rT r� r� r� r� r� r� r� r� �$expected-one-end-tag-but-got-another�ZgotNameZ expectedName� afterBody) r> r� rL r r~ r@ r� rI r` r r) r) r* rw ^ s �z)getPhases.<locals>.InBodyPhase.endTagBodyc S s" | j �d�r | �td�� |S d S )Nr� )r> r� rw r� r� r) r) r* rx p s z)getPhases.<locals>.InBodyPhase.endTagHtmlc S s� |d dkr| j | _| j�|d �}|r2| j�� | jjd j|d kr^| j�dd|d i� |r�| jj� � }|j|d kr�| jj� � }qnd S )Nr@ r4 rv �end-tag-too-early) rY r� r> r� r� r~ r@ rL r r )rC r� ZinScoper� r) r) r* ry v s z*getPhases.<locals>.InBodyPhase.endTagBlockc S sv | j j}d | j _|d ks$| j �|�s8| j�dddi� n:| j �� | j jd |krd| j�dddi� | j j�|� d S )Nr r@ r6 rv zend-tag-too-early-ignored)r> r� r� rL r r� r~ r r r) r) r* rz � s � �z)getPhases.<locals>.InBodyPhase.endTagFormc S s� |d dkrd}nd }| j j|d |d�sB| j�dd|d i� nf| j j|d d� | j jd j|d kr�| j�dd|d i� | j j�� }|j|d kr�| j j�� }q�d S ) Nr@ r7 �listr� r ��excluderv r� )r> r� rL r r� r~ r@ r )rC r� r� r� r) r) r* r| � s � z-getPhases.<locals>.InBodyPhase.endTagListItemc S s� t D ] }| j�|�r| j�� q$q| jjd j|d krP| j�dd|d i� t D ]8}| j�|�rT| jj�� }|jt kr�| jj�� }qp q�qTd S )Nrv r@ r� ) r r> r� r� r~ r@ rL r r )rC r� �itemr) r) r* r} � s z,getPhases.<locals>.InBodyPhase.endTagHeadingc S s d}|dk �r |d7 }| j �|d �}|rD|| j jkrR| j �|j�sR| �|� dS || j jkr�| j�dd|d i� | j j� |� dS | j �|j�s�| j�dd|d i� dS || j jd kr�| j�d d|d i� | j j� |�}d}| j j|d� D ]}|j t kr�|} �qq�|dk�rR| j j� � }||k�r@| j j� � }�q&| j j� |� dS | j j|d }| j j� |�}| } } d} | j j� | �} | d k �rX| d7 } | d8 } | j j| } | | j jk�r�| j j� | � �q�| |k�rސqX| |k�r�| j j� | �d }| �� } | | j j| j j� | �< | | j j| j j� | �< | } | j�rF| j�| � | �| � | } �q�| j�rl| j�| � |jtd �k�r�| j �� \}}|�| |� n |�| � |�� } |�| � |�| � | j j� |� | j j�|| � | j j� |� | j j�| j j� |�d | � qdS ) z)The much-feared adoption agency algorithmr � r r@ Nzadoption-agency-1.2zadoption-agency-4.4rv zadoption-agency-1.3r� �r� r� r� r� r� )r> r� r~ r� r@ r� rL r r� r �indexr� r r Z cloneNoder� r� Z appendChildr� Z getTableMisnestedNodePosition� insertBeforeZreparentChildren�insert)rC r� ZouterLoopCounterZformattingElementZafeIndexZ furthestBlockrn ZcommonAncestorZbookmarkZlastNoder� ZinnerLoopCounterr� Zcloner� r� r) r) r* r~ � s� � � � � �� � �z/getPhases.<locals>.InBodyPhase.endTagFormattingc S s� | j �|d �r| j �� | j jd j|d krF| j�dd|d i� | j �|d �r�| j j�� }|j|d kr~| j j�� }qb| j �� d S )Nr@ rv r� ) r> r� r� r~ r@ rL r r � clearActiveFormattingElements)rC r� rn r) r) r* r T s z8getPhases.<locals>.InBodyPhase.endTagAppletMarqueeObjectc S s@ | j �dddd�� | j�� | j�tdd�� | jj�� d S )Nz unexpected-end-tag-treated-asr� z br elementr� rr )rL r r> r� r� r� r~ r r� r) r) r* r ` s � z'getPhases.<locals>.InBodyPhase.endTagBrc S s� | j jd d d� D ]�}|j|d krz| j j|d d� | j jd j|d krb| j�dd|d i� | j j�� |krtqb q�q|jtkr| j�dd|d i� q�qd S )Nrv r@ r� r ) r> r~ r@ r� rL r r r� r r r) r) r* r� g s z*getPhases.<locals>.InBodyPhase.endTagOtherN)6r9 r: r; rK r� r� r� r� r� rY rZ r r r[ r] r^ r_ r` r\ ra rb rc rd re rf rg rh rj ri rk rl rm rn ro r� rp rs rq rr rt ru rv r� r{ rw rx ry rz r| r} r~ r r r� r) r� r) r* � InBodyPhase� sh G $ r� c s@ e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd S )z getPhases.<locals>.TextPhasec sF � � | ||� t�g �| _| j| j_t�d| jfg�| _| j| j_d S �Nr� ) rK r r� r� r� r� � endTagScriptr� r� r� r� r) r* rK v s �z%getPhases.<locals>.TextPhase.__init__c S s | j �|d � d S r� r� r� r) r) r* r� ~ s z.getPhases.<locals>.TextPhase.processCharactersc S s8 | j �dd| jjd ji� | jj�� | j j| j _dS )Nz&expected-named-closing-tag-but-got-eofr@ rv T)rL r r> r~ r@ r r� r` rB r) r) r* r� � s � z'getPhases.<locals>.TextPhase.processEOFc S s dst d|d ��d S )NFz4Tried to process start tag %s in RCDATA/RAWTEXT moder@ )r� r� r) r) r* r� � s z*getPhases.<locals>.TextPhase.startTagOtherc S s* | j j�� }|jdkst�| jj| j_d S r� )r> r~ r r@ r� rL r� r` r r) r) r* r� � s z)getPhases.<locals>.TextPhase.endTagScriptc S s | j j�� | jj| j_d S r. )r> r~ r rL r� r` r� r) r) r* r� � s z(getPhases.<locals>.TextPhase.endTagOtherN) r9 r: r; rK r� r� r� r� r� r) r� r) r* � TextPhaseu s r� c s� e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'S )(z getPhases.<locals>.InTablePhasec s� � � | ||� t�d| jfd| jfd| jfd| jfd| jfd| jfd| j fd| j fd | j fd | j fg �| _ | j| j _t�d| jfd | jfg�| _| j| j_d S ) Nr� r� r� rW �r� r� r� )r� r� r� r� )r� r� rN r6 ) r� r� rW r� r� r� r� r� r� r� r� )rK r r� r� �startTagCaption�startTagColgroup� startTagCol�startTagRowGroup�startTagImplyTbodyrg �startTagStyleScriptrj r^ r� r� r� � endTagTable� endTagIgnorer� r� r� r� r) r* rK � s* � ��z(getPhases.<locals>.InTablePhase.__init__c S s$ | j jd jdkr | j j�� q d S )Nrv )r� r� )r> r~ r@ r rB r) r) r* �clearStackToTableContext� s z8getPhases.<locals>.InTablePhase.clearStackToTableContextc S s0 | j jd jdkr | j�d� n | jjs,t�d S )Nrv r� z eof-in-table�r> r~ r@ rL r rS r� rB r) r) r* r� � s z*getPhases.<locals>.InTablePhase.processEOFc S s4 | j j}| j jd | j _|| j j_| j j�|� d S �N� inTableText)rL r` rI r� r� �rC r� r� r) r) r* r� � s z6getPhases.<locals>.InTablePhase.processSpaceCharactersc S s4 | j j}| j jd | j _|| j j_| j j�|� d S r� )rL r` rI r� r� r� r) r) r* r� � s z1getPhases.<locals>.InTablePhase.processCharactersc S s& d| j _| jjd �|� d| j _d S )NTr� F)r> �insertFromTablerL rI r� r� r) r) r* r� � s z*getPhases.<locals>.InTablePhase.insertTextc S s6 | � � | jj�t� | j�|� | jjd | j_d S )Nr� ) r� r> r� r� r r� rL rI r` r� r) r) r* r� � s z/getPhases.<locals>.InTablePhase.startTagCaptionc S s( | � � | j�|� | jjd | j_d S )Nr� �r� r> r� rL rI r` r� r) r) r* r� � s z0getPhases.<locals>.InTablePhase.startTagColgroupc S s | � tdd�� |S )Nr� rr )r� r� r� r) r) r* r� � s z+getPhases.<locals>.InTablePhase.startTagColc S s( | � � | j�|� | jjd | j_d S �Nr� r� r� r) r) r* r� � s z0getPhases.<locals>.InTablePhase.startTagRowGroupc S s | � tdd�� |S )Nr� rr )r� r� r� r) r) r* r� � s z2getPhases.<locals>.InTablePhase.startTagImplyTbodyc S s6 | j �dddd�� | j j�td�� | j js2|S d S )Nr� r� r� )rL r r` r� r� rS r� r) r) r* rg � s �z-getPhases.<locals>.InTablePhase.startTagTablec S s | j jd �|�S r r� r� r) r) r* r� � s z3getPhases.<locals>.InTablePhase.startTagStyleScriptc S sV d|d krH|d d � t�dkrH| j�d� | j�|� | jj�� n | �|� d S )Nr3 rw r� z unexpected-hidden-input-in-table) rl r rL r r> r� r~ r r� r� r) r) r* rj � s � z-getPhases.<locals>.InTablePhase.startTagInputc S sD | j �d� | jjd kr@| j�|� | jjd | j_| jj�� d S )Nzunexpected-form-in-tablerv )rL r r> r� r� r~ r r� r) r) r* r^ � s z,getPhases.<locals>.InTablePhase.startTagFormc S s< | j �dd|d i� d| j_| j jd �|� d| j_d S )Nz)unexpected-start-tag-implies-table-voodoor@ Tr� F)rL r r> r� rI r� r� r) r) r* r� s z-getPhases.<locals>.InTablePhase.startTagOtherc S s� | j jddd�r�| j �� | j jd jdkrJ| j�dd| j jd jd�� | j jd jdkrj| j j�� qJ| j j�� | j�� n| jj s�t �| j�� d S )Nr� r� rv zend-tag-too-early-namedr� ) r> r� r� r~ r@ rL r r rb rS r� r� r) r) r* r� s �� z+getPhases.<locals>.InTablePhase.endTagTablec S s | j �dd|d i� d S r r� r� r) r) r* r� s z,getPhases.<locals>.InTablePhase.endTagIgnorec S s< | j �dd|d i� d| j_| j jd �|� d| j_d S )Nz'unexpected-end-tag-implies-table-voodoor@ Tr� F)rL r r> r� rI r� r� r) r) r* r� s z+getPhases.<locals>.InTablePhase.endTagOtherN)r9 r: r; rK r� r� r� r� r� r� r� r� r� r� rg r� rj r^ r� r� r� r� r) r� r) r* � InTablePhase� s& r� c sP e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dS )z#getPhases.<locals>.InTableTextPhasec s � � | ||� d | _g | _d S r. )rK r� �characterTokensr� r� r) r* rK ( s z,getPhases.<locals>.InTableTextPhase.__init__c S sd d� dd� | jD ��}tdd� |D ��rJtd |d�}| jjd �|� n|rZ| j�|� g | _d S )Nr� c S s g | ] }|d �qS )rw r) �r? r� r) r) r* rD . s zGgetPhases.<locals>.InTableTextPhase.flushCharacters.<locals>.<listcomp>c S s g | ] }|t k�qS r) r� r� r) r) r* rD / s rq r� r� )�joinr� r� r rL rI r� r> )rC rw r� r) r) r* �flushCharacters- s z3getPhases.<locals>.InTableTextPhase.flushCharactersc S s | � � | j| j_|S r. �r� r� rL r` r� r) r) r* r� 6 s z2getPhases.<locals>.InTableTextPhase.processCommentc S s | � � | j| j_dS r� r� rB r) r) r* r� ; s z.getPhases.<locals>.InTableTextPhase.processEOFc S s |d dkrd S | j �|� d S �Nrw r� �r� r� r� r) r) r* r� @ s z5getPhases.<locals>.InTableTextPhase.processCharactersc S s | j �|� d S r. r� r� r) r) r* r� E s z:getPhases.<locals>.InTableTextPhase.processSpaceCharactersc S s | � � | j| j_|S r. r� r� r) r) r* r� J s z3getPhases.<locals>.InTableTextPhase.processStartTagc S s | � � | j| j_|S r. r� r� r) r) r* r� O s z1getPhases.<locals>.InTableTextPhase.processEndTagN) r9 r: r; rK r� r� r� r� r� r� r� r) r� r) r* �InTableTextPhase' s r� c s` e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dS )z!getPhases.<locals>.InCaptionPhasec sf � � | ||� t�d| jfd| jfg�| _| j| j_t�d| jfd| j fd| j fg�| _ | j | j _d S )Nr� � r� rW r� r� r� r� r� r� r� r� r� ) r� rW r� r� r� r� r� r� r� r� ) rK r r� r� �startTagTableElementr� r� r� � endTagCaptionr� r� r� r� r� r� r) r* rK V s �� ��z*getPhases.<locals>.InCaptionPhase.__init__c S s | j jddd� S )Nr� r� r� �r> r� rB r) r) r* �ignoreEndTagCaptionh s z5getPhases.<locals>.InCaptionPhase.ignoreEndTagCaptionc S s | j jd �� d S r� �rL rI r� rB r) r) r* r� k s z,getPhases.<locals>.InCaptionPhase.processEOFc S s | j jd �|�S r� �rL rI r� r� r) r) r* r� n s z3getPhases.<locals>.InCaptionPhase.processCharactersc S s0 | j �� | �� }| j j�td�� |s,|S d S �Nr� �rL r r� r` r� r� �rC r� � ignoreEndTagr) r) r* r� q s z6getPhases.<locals>.InCaptionPhase.startTagTableElementc S s | j jd �|�S r� r� r� r) r) r* r� y s z/getPhases.<locals>.InCaptionPhase.startTagOtherc S s� | � � s�| j�� | jjd jdkrB| j�dd| jjd jd�� | jjd jdkrb| jj�� qB| jj�� | j�� | jj d | j_ n| jj s�t �| j�� d S )Nrv r� r� r� r� ) r� r> r� r~ r@ rL r r r� rI r` rS r� r� r) r) r* r� | s �� z/getPhases.<locals>.InCaptionPhase.endTagCaptionc S s0 | j �� | �� }| j j�td�� |s,|S d S r� r� r� r) r) r* r� � s z-getPhases.<locals>.InCaptionPhase.endTagTablec S s | j �dd|d i� d S r r� r� r) r) r* r� � s z.getPhases.<locals>.InCaptionPhase.endTagIgnorec S s | j jd �|�S r� �rL rI r� r� r) r) r* r� � s z-getPhases.<locals>.InCaptionPhase.endTagOtherN) r9 r: r; rK r� r� r� r� r� r� r� r� r� r) r� r) r* �InCaptionPhaseT s r� c sX e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dS )z%getPhases.<locals>.InColumnGroupPhasec s^ � � | ||� t�d| jfd| jfg�| _| j| j_t�d| jfd| j fg�| _ | j | j _d S )Nr� rW r� ) rK r r� r� r� r� r� r� �endTagColgroup� endTagColr� r� r� r� r) r* rK � s � �z.getPhases.<locals>.InColumnGroupPhase.__init__c S s | j jd jdkS )Nrv r� )r> r~ r@ rB r) r) r* �ignoreEndTagColgroup� s z:getPhases.<locals>.InColumnGroupPhase.ignoreEndTagColgroupc S sD | j jd jdkr"| jjs t�d S | �� }| �td�� |s@dS d S )Nrv r� r� T) r> r~ r@ rL rS r� r� r� r� )rC r� r) r) r* r� � s z0getPhases.<locals>.InColumnGroupPhase.processEOFc S s" | � � }| �td�� |s |S d S �Nr� �r� r� r� r� r) r) r* r� � s z7getPhases.<locals>.InColumnGroupPhase.processCharactersc S s$ | j �|� | j j�� d|d< d S r r r� r) r) r* r� � s z1getPhases.<locals>.InColumnGroupPhase.startTagColc S s" | � � }| �td�� |s |S d S r� r� r� r) r) r* r� � s z3getPhases.<locals>.InColumnGroupPhase.startTagOtherc S s@ | � � r | jjst�| j�� n | jj�� | jjd | j_ d S �Nr� ) r� rL rS r� r r> r~ r rI r` r� r) r) r* r� � s z4getPhases.<locals>.InColumnGroupPhase.endTagColgroupc S s | j �dddi� d S )Nz no-end-tagr@ rW r� r� r) r) r* r� � s z/getPhases.<locals>.InColumnGroupPhase.endTagColc S s" | � � }| �td�� |s |S d S r� r� r� r) r) r* r� � s z1getPhases.<locals>.InColumnGroupPhase.endTagOtherN) r9 r: r; rK r� r� r� r� r� r� r� r� r) r� r) r* �InColumnGroupPhase� s r� c sx e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� ZdS ) z#getPhases.<locals>.InTableBodyPhasec sv � � | ||� t�d| jfd| jfd| jfd| jfg�| _| j| j_ t�d| j fd| j fd| j fg�| _ | j| j _ d S )Nr� r� �r� r� )r� rW r� r� r� r� r� r� )r� r� rW r� r� r� r� r� )rK r r� r� � startTagTr�startTagTableCell�startTagTableOtherr� r� r� �endTagTableRowGroupr� r� r� r� r� r� r) r* rK � s$ �� ��z,getPhases.<locals>.InTableBodyPhase.__init__c S sB | j jd jdkr | j j�� q | j jd jdkr>| jjs>t�d S )Nrv )r� r� r� r� r� )r> r~ r@ r rL rS r� rB r) r) r* � clearStackToTableBodyContext� s z@getPhases.<locals>.InTableBodyPhase.clearStackToTableBodyContextc S s | j jd �� d S r� r� rB r) r) r* r� � s z.getPhases.<locals>.InTableBodyPhase.processEOFc S s | j jd �|�S r� r r� r) r) r* r� s z:getPhases.<locals>.InTableBodyPhase.processSpaceCharactersc S s | j jd �|�S r� r� r� r) r) r* r� s z5getPhases.<locals>.InTableBodyPhase.processCharactersc S s( | � � | j�|� | jjd | j_d S )Nr� )r� r> r� rL rI r` r� r) r) r* r� s z.getPhases.<locals>.InTableBodyPhase.startTagTrc S s* | j �dd|d i� | �tdd�� |S )Nz unexpected-cell-in-table-bodyr@ r� rr )rL r r� r� r� r) r) r* r� s �z5getPhases.<locals>.InTableBodyPhase.startTagTableCellc S sn | j jddd�s0| j jddd�s0| j jddd�rT| �� | �t| j jd j�� |S | jjs`t �| j� � d S �Nr� r� r� r� r� rv � r> r� r� r� r� r~ r@ rL rS r� r r� r) r) r* r� s ��� z6getPhases.<locals>.InTableBodyPhase.startTagTableOtherc S s | j jd �|�S r� r� r� r) r) r* r� s z1getPhases.<locals>.InTableBodyPhase.startTagOtherc S sT | j j|d dd�r:| �� | j j�� | jjd | j_n| j�dd|d i� d S )Nr@ r� r� r� � unexpected-end-tag-in-table-body) r> r� r� r~ r rL rI r` r r� r) r) r* r� " s �z7getPhases.<locals>.InTableBodyPhase.endTagTableRowGroupc S sn | j jddd�s0| j jddd�s0| j jddd�rT| �� | �t| j jd j�� |S | jjs`t �| j� � d S r� r� r� r) r) r* r� + s ��� z/getPhases.<locals>.InTableBodyPhase.endTagTablec S s | j �dd|d i� d S )Nr� r@ r� r� r) r) r* r� 8 s �z0getPhases.<locals>.InTableBodyPhase.endTagIgnorec S s | j jd �|�S r� r� r� r) r) r* r� < s z/getPhases.<locals>.InTableBodyPhase.endTagOtherN)r9 r: r; rK r� r� r� r� r� r� r� r� r� r� r� r� r) r� r) r* �InTableBodyPhase� s r� c s� e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd S ) z getPhases.<locals>.InRowPhasec sv � � | ||� t�d| jfd| jfd| jfg�| _| j| j_t�d| j fd| j fd| j fd| j fg�| _ | j| j _d S )Nr� r� )r� rW r� r� r� r� r� r� r� r� )r� r� rW r� r� r� r� )rK r r� r� r� r� r� r� r� �endTagTrr� r� r� r� r� r� r� r) r* rK A s$ �� ��z&getPhases.<locals>.InRowPhase.__init__c S s@ | j jd jdkr<| j�dd| j jd ji� | j j�� q d S )Nrv )r� r� z'unexpected-implied-end-tag-in-table-rowr@ )r> r~ r@ rL r r rB r) r) r* �clearStackToTableRowContextU s �z9getPhases.<locals>.InRowPhase.clearStackToTableRowContextc S s | j jddd� S )Nr� r� r� r� rB r) r) r* �ignoreEndTagTr[ s z,getPhases.<locals>.InRowPhase.ignoreEndTagTrc S s | j jd �� d S r� r� rB r) r) r* r� _ s z(getPhases.<locals>.InRowPhase.processEOFc S s | j jd �|�S r� r r� r) r) r* r� b s z4getPhases.<locals>.InRowPhase.processSpaceCharactersc S s | j jd �|�S r� r� r� r) r) r* r� e s z/getPhases.<locals>.InRowPhase.processCharactersc S s6 | � � | j�|� | jjd | j_| jj�t� d S )Nr� ) r� r> r� rL rI r` r� r� r r� r) r) r* r� h s z/getPhases.<locals>.InRowPhase.startTagTableCellc S s" | � � }| �td�� |s |S d S �Nr� �r� r� r� r� r) r) r* r� n s z0getPhases.<locals>.InRowPhase.startTagTableOtherc S s | j jd �|�S r� r� r� r) r) r* r� u s z+getPhases.<locals>.InRowPhase.startTagOtherc S sH | � � s.| �� | jj�� | jjd | j_n| jjs:t �| j� � d S r� ) r� r� r> r~ r rL rI r` rS r� r r� r) r) r* r� x s z&getPhases.<locals>.InRowPhase.endTagTrc S s" | � � }| �td�� |s |S d S r� r� r� r) r) r* r� � s z)getPhases.<locals>.InRowPhase.endTagTablec S s4 | j j|d dd�r&| �td�� |S | j�� d S )Nr@ r� r� r� )r> r� r� r� rL r r� r) r) r* r� � s z1getPhases.<locals>.InRowPhase.endTagTableRowGroupc S s | j �dd|d i� d S )Nz unexpected-end-tag-in-table-rowr@ r� r� r) r) r* r� � s �z*getPhases.<locals>.InRowPhase.endTagIgnorec S s | j jd �|�S r� r� r� r) r) r* r� � s z)getPhases.<locals>.InRowPhase.endTagOtherN)r9 r: r; rK r� r� r� r� r� r� r� r� r� r� r� r� r� r) r� r) r* � InRowPhase? s r� c s` e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dS )z getPhases.<locals>.InCellPhasec sf � � | ||� t�d| jfd| jfg�| _| j| j_t�d| jfd| j fd| j fg�| _ | j | j _d S )Nr� r� r� )r� r� rW r� r� r� ) rK r r� r� r� r� r� r� �endTagTableCellr� � endTagImplyr� r� r� r� r) r* rK � s �� �z'getPhases.<locals>.InCellPhase.__init__c S sB | j jddd�r | �td�� n | j jddd�r>| �td�� d S �Nr� r� r� r� )r> r� r� r� rB r) r) r* � closeCell� s z(getPhases.<locals>.InCellPhase.closeCellc S s | j jd �� d S r� r� rB r) r) r* r� � s z)getPhases.<locals>.InCellPhase.processEOFc S s | j jd �|�S r� r� r� r) r) r* r� � s z0getPhases.<locals>.InCellPhase.processCharactersc S sF | j jddd�s | j jddd�r,| �� |S | jjs8t�| j�� d S r� )r> r� r� rL rS r� r r� r) r) r* r� � s � z1getPhases.<locals>.InCellPhase.startTagTableOtherc S s | j jd �|�S r� r� r� r) r) r* r� � s z,getPhases.<locals>.InCellPhase.startTagOtherc S s� | j j|d dd�r�| j �|d � | j jd j|d krp| j�dd|d i� | j j�� }|j|d krPq|qPn | j j�� | j �� | jj d | j_ n| j�dd|d i� d S )Nr@ r� r� rv zunexpected-cell-end-tagr� r ) r> r� r� r~ r@ rL r r r� rI r` r r) r) r* r� � s � z.getPhases.<locals>.InCellPhase.endTagTableCellc S s | j �dd|d i� d S r r� r� r) r) r* r� � s z+getPhases.<locals>.InCellPhase.endTagIgnorec S s. | j j|d dd�r | �� |S | j�� d S )Nr@ r� r� )r> r� r� rL r r� r) r) r* r� � s z*getPhases.<locals>.InCellPhase.endTagImplyc S s | j jd �|�S r� r� r� r) r) r* r� � s z*getPhases.<locals>.InCellPhase.endTagOtherN) r9 r: r; rK r� r� r� r� r� r� r� r� r� r) r� r) r* � InCellPhase� s r� c sx e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� ZdS ) z getPhases.<locals>.InSelectPhasec s� � � | ||� t�d| jfd| jfd| jfd| jfd| jfd| jfg�| _ | j | j _ t�d| j fd| j fd| jfg�| _| j| j_ d S )Nr� rU rV r� )rN rL rR r� )rK r r� r� �startTagOption�startTagOptgrouprq rj r� r� r� r� � endTagOption�endTagOptgroup� endTagSelectr� r� r� r� r) r* rK � s � �z)getPhases.<locals>.InSelectPhase.__init__c S s0 | j jd jdkr | j�d� n | jjs,t�d S )Nrv r� z eof-in-selectr� rB r) r) r* r� � s z+getPhases.<locals>.InSelectPhase.processEOFc S s$ |d dkrd S | j �|d � d S r� r� r� r) r) r* r� s z2getPhases.<locals>.InSelectPhase.processCharactersc S s. | j jd jdkr | j j�� | j �|� d S r� �r> r~ r@ r r� r� r) r) r* r� s z/getPhases.<locals>.InSelectPhase.startTagOptionc S sL | j jd jdkr | j j�� | j jd jdkr<| j j�� | j �|� d S )Nrv rU rV r� r� r) r) r* r� s z1getPhases.<locals>.InSelectPhase.startTagOptgroupc S s | j �d� | �td�� d S )Nzunexpected-select-in-selectr� )rL r r� r� r� r) r) r* rq s z/getPhases.<locals>.InSelectPhase.startTagSelectc S s> | j �d� | jjddd�r.| �td�� |S | j js:t�d S )Nzunexpected-input-in-selectr� r� )rL r r> r� r� r� rS r� r� r) r) r* rj s z.getPhases.<locals>.InSelectPhase.startTagInputc S s | j jd �|�S r r� r� r) r) r* r� s z/getPhases.<locals>.InSelectPhase.startTagScriptc S s | j �dd|d i� d S )Nz unexpected-start-tag-in-selectr@ r� r� r) r) r* r� ! s �z.getPhases.<locals>.InSelectPhase.startTagOtherc S s6 | j jd jdkr | j j�� n| j�dddi� d S )Nrv rU � unexpected-end-tag-in-selectr@ �r> r~ r@ r rL r r� r) r) r* r� % s �z-getPhases.<locals>.InSelectPhase.endTagOptionc S sf | j jd jdkr0| j jd jdkr0| j j�� | j jd jdkrP| j j�� n| j�dddi� d S )Nrv rU ���rV r r@ r r� r) r) r* r� , s � �z/getPhases.<locals>.InSelectPhase.endTagOptgroupc S sZ | j jddd�r@| j j�� }|jdkr4| j j�� }q | j�� n| jjsLt�| j� � d S )Nr� r� ) r> r� r~ r r@ rL rb rS r� r r r) r) r* r� 9 s z-getPhases.<locals>.InSelectPhase.endTagSelectc S s | j �dd|d i� d S )Nr r@ r� r� r) r) r* r� D s �z,getPhases.<locals>.InSelectPhase.endTagOtherN)r9 r: r; rK r� r� r� r� rq rj r� r� r� r� r� r� r) r� r) r* � InSelectPhase� s r c sH e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dS )z'getPhases.<locals>.InSelectInTablePhasec sN � � | ||� t�d| jfg�| _| j| j_t�d| jfg�| _| j | j_d S )N)r� r� r� r� r� r� r� r� ) rK r r� rg r� r� r� r� r� r� r� r� r) r* rK I s �� ��z0getPhases.<locals>.InSelectInTablePhase.__init__c S s | j jd �� d S �Nr� r� rB r) r) r* r� X s z2getPhases.<locals>.InSelectInTablePhase.processEOFc S s | j jd �|�S r r� r� r) r) r* r� [ s z9getPhases.<locals>.InSelectInTablePhase.processCharactersc S s( | j �dd|d i� | �td�� |S )Nz5unexpected-table-element-start-tag-in-select-in-tabler@ r� )rL r r� r� r� r) r) r* rg ^ s z5getPhases.<locals>.InSelectInTablePhase.startTagTablec S s | j jd �|�S r r� r� r) r) r* r� c s z5getPhases.<locals>.InSelectInTablePhase.startTagOtherc S s@ | j �dd|d i� | jj|d dd�r<| �td�� |S d S )Nz3unexpected-table-element-end-tag-in-select-in-tabler@ r� r� r� )rL r r> r� r� r� r� r) r) r* r� f s z3getPhases.<locals>.InSelectInTablePhase.endTagTablec S s | j jd �|�S r r� r� r) r) r* r� l s z3getPhases.<locals>.InSelectInTablePhase.endTagOtherN) r9 r: r; rK r� r� rg r� r� r� r) r� r) r* �InSelectInTablePhaseH s r c - s� e Zd Zeddddddddd d d d d ddddddddddddddd d d d d d!d"d#d$d%d&d'd(d)d*d+d,g,�Z� fd-d.�Zd/d0� Z� fd1d2�Zd3d4� Zd5d6� Z d7S )8z(getPhases.<locals>.InForeignContentPhaser; r< r" r� r� r# r= r8 r+ r& r9 r> rJ Zh1Zh2Zh3Zh4Zh5Zh6r� rO r@ rK r7 r5 r. r5 rG r0 r( r4 r� rA rB �spanrD rC �subZsupr� rE rF r3 �varc s � � | ||� d S r. )rK r� r� r) r* rK y s z1getPhases.<locals>.InForeignContentPhase.__init__c % S sn ddddddddd d d d d ddddddddddddddd d d d d d!d"d#d$d%�$}|d& |krj||d& |d&< d S )'NZaltGlyphZ altGlyphDefZ altGlyphItemZ animateColorZ animateMotionZanimateTransformZclipPathZfeBlendZ feColorMatrixZfeComponentTransferZ feCompositeZfeConvolveMatrixZfeDiffuseLightingZfeDisplacementMapZfeDistantLightZfeFloodZfeFuncAZfeFuncBZfeFuncGZfeFuncRZfeGaussianBlurZfeImageZfeMergeZ feMergeNodeZ feMorphologyZfeOffsetZ fePointLightZfeSpecularLightingZ feSpotLightZfeTileZ feTurbulenceZ foreignObjectZglyphRefZlinearGradientZradialGradientZtextPath)$ZaltglyphZ altglyphdefZ altglyphitemZ animatecolorZ animatemotionZanimatetransformZclippathZfeblendZ fecolormatrixZfecomponenttransferZ fecompositeZfeconvolvematrixZfediffuselightingZfedisplacementmapZfedistantlightZfefloodZfefuncaZfefuncbZfefuncgZfefuncrZfegaussianblurZfeimageZfemergeZ femergenodeZ femorphologyZfeoffsetZ fepointlightZfespecularlightingZ fespotlightZfetileZ feturbulenceZ foreignobjectZglyphrefZlineargradientZradialgradientZtextpathr@ r) )rC r� � replacementsr) r) r* �adjustSVGTagNames| sN �% z:getPhases.<locals>.InForeignContentPhase.adjustSVGTagNamesc sL |d dkrd|d< n&| j jr<tdd� |d D ��r<d| j _� �| |� d S )Nrw r� u �c s s | ]}|t kV qd S r. r� r� r) r) r* r� � s zMgetPhases.<locals>.InForeignContentPhase.processCharacters.<locals>.<genexpr>F)rL rc r� r� r� r� r) r* r� � s �z:getPhases.<locals>.InForeignContentPhase.processCharactersc S s. | j jd }|d | jksD|d dkr�t|d �� �tdddg�@ r�| j�dd|d i� | j jd j| j jkr�| j� | j jd �s�| j� | j jd �s�| j j� � qZ|S |jt d kr�| j� |� n$|jt d kr�| �|� | j�|� | j�|� |j|d < | j �|� |d �r*| j j� � d |d< d S )Nrv r@ r? rw ZcolorZface�sizez*unexpected-html-element-in-foreign-contentrh ry rj r{ Tr| )r> r~ �breakoutElements�set�keysrL r rj r� ro rp r r r r r r r� )rC r� r� r) r) r* r� � s: � � � ��� z8getPhases.<locals>.InForeignContentPhase.processStartTagc S s� t | jj�d }| jjd }|j�t�|d krF| j�dd|d i� |j�t�|d kr�| jj| jj d kr�| jj� � | jjj | j_| jj� � |kr�| jjs�t �q�d }q�|d8 }| jj| }|j| jjkr�qFqF| jj�|�}q�qF|S )Nr rv r@ r r� )r� r> r~ r@ rl r rL r r` rI r� r� r r� rj r� r� )rC r� Z nodeIndexr� r� r) r) r* r� � s& z6getPhases.<locals>.InForeignContentPhase.processEndTagN) r9 r: r; r� r rK r r� r� r� r) r� r) r* �InForeignContentPhaseo s\ � ) r c sP e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dS )z!getPhases.<locals>.AfterBodyPhasec sN � � | ||� t�d| jfg�| _| j| j_t�d| jfg�| _| j | j_d S �Nr� ) rK r r� r� r� r� r� rx r� r� r� r� r) r* rK � s � z*getPhases.<locals>.AfterBodyPhase.__init__c S s d S r. r) rB r) r) r* r� � s z,getPhases.<locals>.AfterBodyPhase.processEOFc S s | j �|| j jd � d S )Nr r� r� r) r) r* r� � s z0getPhases.<locals>.AfterBodyPhase.processCommentc S s | j �d� | j jd | j _|S )Nzunexpected-char-after-bodyr� �rL r rI r` r� r) r) r* r� � s z3getPhases.<locals>.AfterBodyPhase.processCharactersc S s | j jd �|�S r� r� r� r) r) r* r� � s z.getPhases.<locals>.AfterBodyPhase.startTagHtmlc S s* | j �dd|d i� | j jd | j _|S )Nz unexpected-start-tag-after-bodyr@ r� r r� r) r) r* r� � s �z/getPhases.<locals>.AfterBodyPhase.startTagOtherc S s* | j jr| j �d� n| j jd | j _d S )Nz'unexpected-end-tag-after-body-innerhtml�afterAfterBody)rL rS r rI r` )rC r@ r) r) r* rx s z,getPhases.<locals>.AfterBodyPhase.endTagHtmlc S s* | j �dd|d i� | j jd | j _|S )Nz unexpected-end-tag-after-bodyr@ r� r r� r) r) r* r� s �z-getPhases.<locals>.AfterBodyPhase.endTagOtherN) r9 r: r; rK r� r� r� r� r� rx r� r) r� r) r* �AfterBodyPhase� s r c sX e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dS )z"getPhases.<locals>.InFramesetPhasec sf � � | ||� t�d| jfd| jfd| jfd| jfg�| _| j| j_ t�d| j fg�| _ | j | j _ d S )Nr� r� rX r� ) rK r r� r� r � startTagFrame�startTagNoframesr� r� r� �endTagFramesetr� r� r� r� r) r* rK s � �z+getPhases.<locals>.InFramesetPhase.__init__c S s0 | j jd jdkr | j�d� n | jjs,t�d S )Nrv r� zeof-in-framesetr� rB r) r) r* r� # s z-getPhases.<locals>.InFramesetPhase.processEOFc S s | j �d� d S )Nzunexpected-char-in-framesetr� r� r) r) r* r� ) s z4getPhases.<locals>.InFramesetPhase.processCharactersc S s | j �|� d S r. )r> r� r� r) r) r* r , s z3getPhases.<locals>.InFramesetPhase.startTagFramesetc S s | j �|� | j j�� d S r. r r� r) r) r* r / s z0getPhases.<locals>.InFramesetPhase.startTagFramec S s | j jd �|�S r� r� r� r) r) r* r 3 s z3getPhases.<locals>.InFramesetPhase.startTagNoframesc S s | j �dd|d i� d S )Nz unexpected-start-tag-in-framesetr@ r� r� r) r) r* r� 6 s �z0getPhases.<locals>.InFramesetPhase.startTagOtherc S sZ | j jd jdkr | j�d� n | j j�� | jjsV| j jd jdkrV| jjd | j_d S )Nrv r� z)unexpected-frameset-in-frameset-innerhtmlr� � afterFrameset) r> r~ r@ rL r r rS rI r` r� r) r) r* r : s �z1getPhases.<locals>.InFramesetPhase.endTagFramesetc S s | j �dd|d i� d S )Nz unexpected-end-tag-in-framesetr@ r� r� r) r) r* r� F s �z.getPhases.<locals>.InFramesetPhase.endTagOtherN) r9 r: r; rK r� r� r r r r� r r� r) r� r) r* �InFramesetPhase s r c sH e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dS )z%getPhases.<locals>.AfterFramesetPhasec sV � � | ||� t�d| jfd| jfg�| _| j| j_t�d| jfg�| _ | j | j _d S �Nr� r� ) rK r r� r� r r� r� r� rx r� r� r� r� r) r* rK L s � �z.getPhases.<locals>.AfterFramesetPhase.__init__c S s d S r. r) rB r) r) r* r� Z s z0getPhases.<locals>.AfterFramesetPhase.processEOFc S s | j �d� d S )Nz unexpected-char-after-framesetr� r� r) r) r* r� ^ s z7getPhases.<locals>.AfterFramesetPhase.processCharactersc S s | j jd �|�S r r� r� r) r) r* r a s z6getPhases.<locals>.AfterFramesetPhase.startTagNoframesc S s | j �dd|d i� d S )Nz#unexpected-start-tag-after-framesetr@ r� r� r) r) r* r� d s �z3getPhases.<locals>.AfterFramesetPhase.startTagOtherc S s | j jd | j _d S )N�afterAfterFrameset)rL rI r` r� r) r) r* rx h s z0getPhases.<locals>.AfterFramesetPhase.endTagHtmlc S s | j �dd|d i� d S )Nz!unexpected-end-tag-after-framesetr@ r� r� r) r) r* r� k s �z1getPhases.<locals>.AfterFramesetPhase.endTagOtherN) r9 r: r; rK r� r� r r� rx r� r) r� r) r* �AfterFramesetPhaseJ s r c sP e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dS )z&getPhases.<locals>.AfterAfterBodyPhasec s0 � � | ||� t�d| jfg�| _| j| j_d S r )rK r r� r� r� r� r� r� r� r) r* rK p s �z/getPhases.<locals>.AfterAfterBodyPhase.__init__c S s d S r. r) rB r) r) r* r� x s z1getPhases.<locals>.AfterAfterBodyPhase.processEOFc S s | j �|| j j� d S r. r� r� r) r) r* r� { s z5getPhases.<locals>.AfterAfterBodyPhase.processCommentc S s | j jd �|�S r� r r� r) r) r* r� ~ s z=getPhases.<locals>.AfterAfterBodyPhase.processSpaceCharactersc S s | j �d� | j jd | j _|S )N�expected-eof-but-got-charr� r r� r) r) r* r� � s z8getPhases.<locals>.AfterAfterBodyPhase.processCharactersc S s | j jd �|�S r� r� r� r) r) r* r� � s z3getPhases.<locals>.AfterAfterBodyPhase.startTagHtmlc S s* | j �dd|d i� | j jd | j _|S )N� expected-eof-but-got-start-tagr@ r� r r� r) r) r* r� � s �z4getPhases.<locals>.AfterAfterBodyPhase.startTagOtherc S s* | j �dd|d i� | j jd | j _|S )N� expected-eof-but-got-end-tagr@ r� r r� r) r) r* r� � s �z4getPhases.<locals>.AfterAfterBodyPhase.processEndTagN) r9 r: r; rK r� r� r� r� r� r� r� r) r� r) r* �AfterAfterBodyPhaseo s r c sX e Zd Z� fdd�Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dS )z*getPhases.<locals>.AfterAfterFramesetPhasec s8 � � | ||� t�d| jfd| jfg�| _| j| j_d S r )rK r r� r� �startTagNoFramesr� r� r� r� r� r) r* rK � s �z3getPhases.<locals>.AfterAfterFramesetPhase.__init__c S s d S r. r) rB r) r) r* r� � s z5getPhases.<locals>.AfterAfterFramesetPhase.processEOFc S s | j �|| j j� d S r. r� r� r) r) r* r� � s z9getPhases.<locals>.AfterAfterFramesetPhase.processCommentc S s | j jd �|�S r� r r� r) r) r* r� � s zAgetPhases.<locals>.AfterAfterFramesetPhase.processSpaceCharactersc S s | j �d� d S )Nr r� r� r) r) r* r� � s z<getPhases.<locals>.AfterAfterFramesetPhase.processCharactersc S s | j jd �|�S r� r� r� r) r) r* r� � s z7getPhases.<locals>.AfterAfterFramesetPhase.startTagHtmlc S s | j jd �|�S r r� r� r) r) r* r � s z;getPhases.<locals>.AfterAfterFramesetPhase.startTagNoFramesc S s | j �dd|d i� d S )Nr r@ r� r� r) r) r* r� � s �z8getPhases.<locals>.AfterAfterFramesetPhase.startTagOtherc S s | j �dd|d i� d S )Nr r@ r� r� r) r) r* r� � s �z8getPhases.<locals>.AfterAfterFramesetPhase.processEndTagN) r9 r: r; rK r� r� r� r� r� r r� r� r) r� r) r* �AfterAfterFramesetPhase� s r! )rW rV r� r� r r r� r� r� r� r� r� r� r� r� r� r� rz r� r� r r r )r )rJ rY r� r� r� r� r r r r� r� r� r� r� r� r� r� r� r r r r r r r r! r) r� r* rH � sr ) #.g@C X! -GBbYLd's/9%&&�rH c s> t | d �t � �@ }|r:t� fdd�| d �� D ��| d< d S )Nrw c 3 s" | ]\}}� � ||�|fV qd S r. )r� )r? �k�v�r r) r* r� � s �z$adjust_attributes.<locals>.<genexpr>)r r r/ )r� r Zneeds_adjustmentr) r$ r* r� � s �r� rs Fc C s |d kr i }t | | ||d�S )N)r3 r@ rw r{ )r )r@ r3 rk r{ r) r) r* r� � s �r� c @ s e Zd ZdZdS )ru zError in parsed documentN)r9 r: r; r� r) r) r) r* ru � s ru )r T)r+ r T)rs NF).Z __future__r r r Zpip._vendor.sixr r r1 � collectionsr r� r r r Ztreebuilders.baser r Z constantsr r r r r r r r r r r r r� r r r r r# r- r= rI r" ZmemoizerH r� r� � Exceptionru r) r) r) r* �<module> sP H G K �