B
b�`M� � @ sL d dgZ ddlmZ ddlT G dd� de�ZG dd� d�ZG dd � d �Zd S )
�Scanner� ScannerError� )�MarkedYAMLError)�*c @ s e Zd ZdS )r N)�__name__�
__module__� __qualname__� r r �?/opt/alt/python37/lib64/python3.7/site-packages/yaml/scanner.pyr s c @ s e Zd Zdd� ZdS )� SimpleKeyc C s( || _ || _|| _|| _|| _|| _d S )N)� token_number�required�index�line�column�mark)�selfr r
r r r r r r r
�__init__& s zSimpleKey.__init__N)r r r r r r r r
r # s r c @ sz e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Z d5d6� Z d7d8� Z d9d:� Z d;d<� Z d=d>� Z!d?d@� Z"dAdB� Z#dCdD� Z$dEdF� Z%dGdH� Z&dIdJ� Z'dKdL� Z(dMdN� Z)dOdP� Z*dQdR� Z+dSdT� Z,dUdV� Z-dWdX� Z.dYdZ� Z/d[d\� Z0d]d^� Z1d_d`� Z2dadb� Z3dcdd� Z4dedf� Z5dgdh� Z6didj� Z7dkdl� Z8dmdn� Z9dodp� Z:dqdr� Z;dsdt� Zdydz� Z?d{d|� Z@d}d~dd�d�d�d�d�d�d�d�d�d�d�d�d�d�d�d��ZAd�d�d�d��ZBd�d�� ZCd�d�� ZDd�d�� ZEd�d�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKd�S )�r c C s< d| _ d| _g | _| �� d| _d| _g | _d| _i | _dS )zInitialize the scanner.F� �����TN) �done�
flow_level�tokens�fetch_stream_start� tokens_taken�indent�indents�allow_simple_key�possible_simple_keys)r r r r
r 0 s zScanner.__init__c G sJ x| � � r| �� qW | jrF|s$dS x |D ]}t| jd |�r*dS q*W dS )NTr F)�need_more_tokens�fetch_more_tokensr �
isinstance)r �choices�choicer r r
� check_tokenq s
zScanner.check_tokenc C s. x| � � r| �� qW | jr&| jd S d S d S )Nr )r r r )r r r r
�
peek_token} s
zScanner.peek_tokenc C s: x| � � r| �� qW | jr6| jd7 _| j�d�S d S )Nr r )r r r r �pop)r r r r
� get_token� s
zScanner.get_tokenc C s2 | j r
dS | jsdS | �� | �� | jkr.dS d S )NFT)r r �stale_possible_simple_keys�next_possible_simple_keyr )r r r r
r � s zScanner.need_more_tokensc C s� | � � | �� | �| j� | �� }|dkr4| �� S |dkrL| �� rL| �� S |dkrd| �� rd| � � S |dkr|| �
� r|| � � S |dkr�| � � S |dkr�| �
� S |dkr�| �� S |dkr�| �� S |d kr�| �� S |dkr�| �� r�| �� S |d
kr�| �� r�| �� S |d k�r| �� �r| �� S |d k�r*| �� S |d
k�r<| �� S |dk�rN| �� S |dk�rh| j�sh| �� S |dk�r�| j�s�| � � S |dk�r�| � � S |dk�r�| � � S | � � �r�| � � S t!dd d| | �"� ��d S )N� �%�-�.�[�{�]�}�,�?�:r �&�!�|�>�'�"z!while scanning for the next tokenz.found character %r that cannot start any token)#�scan_to_next_tokenr( �
unwind_indentr �peek�fetch_stream_end�check_directive�fetch_directive�check_document_start�fetch_document_start�check_document_end�fetch_document_end�fetch_flow_sequence_start�fetch_flow_mapping_start�fetch_flow_sequence_end�fetch_flow_mapping_end�fetch_flow_entry�check_block_entry�fetch_block_entry� check_key� fetch_key� check_value� fetch_value� fetch_alias� fetch_anchor� fetch_tagr �
fetch_literal� fetch_folded� fetch_single� fetch_double� check_plain� fetch_plainr �get_mark)r �chr r r
r � s^
zScanner.fetch_more_tokensc C s: d }x0| j D ]&}| j | }|d ks,|j|k r |j}q W |S )N)r r )r Zmin_token_number�level�keyr r r
r) s
z Scanner.next_possible_simple_keyc C s` xZt | j�D ]L}| j| }|j| jks6| j|j dkr |jrPtd|jd| �� ��| j|= q W d S )Ni zwhile scanning a simple keyzcould not find expected ':')�listr r r r
r r rY )r r[ r\ r r r
r( s
z"Scanner.stale_possible_simple_keysc C s^ | j o| j| jk}| jrZ| �� | jt| j� }t||| j | j
| j| � � �}|| j | j < d S )N)
r r r r �remove_possible_simple_keyr �lenr r r r rY r )r r
r r\ r r r
�save_possible_simple_key' s z Scanner.save_possible_simple_keyc C s@ | j | jkr<| j| j }|jr2td|jd| �� ��| j| j = d S )Nzwhile scanning a simple keyzcould not find expected ':')r r r
r r rY )r r\ r r r
r^ 8 s z"Scanner.remove_possible_simple_keyc C sD | j r
d S x4| j|kr>| �� }| j�� | _| j�t||�� q W d S )N)r r rY r r& r �appendZ
BlockEndToken)r r r r r r
r< E s zScanner.unwind_indentc C s& | j |k r"| j�| j � || _ dS dS )NTF)r r ra )r r r r r
�
add_indent] s
zScanner.add_indentc C s$ | � � }| j�t||| jd�� d S )N)�encoding)rY r ra ZStreamStartTokenrc )r r r r r
r g s zScanner.fetch_stream_startc C sB | � d� | �� d| _i | _| �� }| j�t||�� d| _d S )Nr FT) r< r^ r r rY r ra ZStreamEndTokenr )r r r r r
r> s s
zScanner.fetch_stream_endc C s, | � d� | �� d| _| j�| �� � d S )Nr F)r< r^ r r ra �scan_directive)r r r r
r@ � s
zScanner.fetch_directivec C s | � t� d S )N)�fetch_document_indicatorZDocumentStartToken)r r r r
rB � s z Scanner.fetch_document_startc C s | � t� d S )N)re ZDocumentEndToken)r r r r
rD � s zScanner.fetch_document_endc C sH | � d� | �� d| _| �� }| �d� | �� }| j�|||�� d S )Nr F� )r< r^ r rY �forwardr ra )r �
TokenClass�
start_mark�end_markr r r
re � s
z Scanner.fetch_document_indicatorc C s | � t� d S )N)�fetch_flow_collection_startZFlowSequenceStartToken)r r r r
rE � s z!Scanner.fetch_flow_sequence_startc C s | � t� d S )N)rk ZFlowMappingStartToken)r r r r
rF � s z Scanner.fetch_flow_mapping_startc C sJ | � � | jd7 _d| _| �� }| �� | �� }| j�|||�� d S )Nr T)r` r r rY rg r ra )r rh ri rj r r r
rk � s z#Scanner.fetch_flow_collection_startc C s | � t� d S )N)�fetch_flow_collection_endZFlowSequenceEndToken)r r r r
rG � s z Scanner.fetch_flow_sequence_endc C s | � t� d S )N)rl ZFlowMappingEndToken)r r r r
rH � s z Scanner.fetch_flow_mapping_endc C sJ | � � | jd8 _d| _| �� }| �� | �� }| j�|||�� d S )Nr F)r^ r r rY rg r ra )r rh ri rj r r r
rl � s z!Scanner.fetch_flow_collection_endc C s< d| _ | �� | �� }| �� | �� }| j�t||�� d S )NT)r r^ rY rg r ra ZFlowEntryToken)r ri rj r r r
rI � s zScanner.fetch_flow_entryc C s� | j sF| js td d d| �� ��| �| j�rF| �� }| j�t||�� n d| _| � � | �� }| �
� | �� }| j�t ||�� d S )Nz%sequence entries are not allowed hereT) r r r rY rb r r ra ZBlockSequenceStartTokenr^ rg ZBlockEntryToken)r r ri rj r r r
rK � s
zScanner.fetch_block_entryc C s� | j sD| js td d d| �� ��| �| j�rD| �� }| j�t||�� | j | _| � � | �� }| �
� | �� }| j�t ||�� d S )Nz!mapping keys are not allowed here) r r r rY rb r r ra �BlockMappingStartTokenr^ rg �KeyToken)r r ri rj r r r
rM s
zScanner.fetch_keyc C s | j | jkr|| j| j }| j| j = | j�|j| j t|j|j�� | j st| �|j �rt| j�|j| j t
|j|j�� d| _ n\| j s�| j s�t d d d| �
� ��| j s�| �| j �r�| �
� }| j�t
||�� | j | _ | �� | �
� }| �� | �
� }| j�t||�� d S )NFz#mapping values are not allowed here)r r r �insertr r rn r rb r rm r r rY ra r^ rg Z
ValueToken)r r\ r ri rj r r r
rO ! s2
zScanner.fetch_valuec C s$ | � � d| _| j�| �t�� d S )NF)r` r r ra � scan_anchorZ
AliasToken)r r r r
rP Y s zScanner.fetch_aliasc C s$ | � � d| _| j�| �t�� d S )NF)r` r r ra rp Z AnchorToken)r r r r
rQ d s zScanner.fetch_anchorc C s" | � � d| _| j�| �� � d S )NF)r` r r ra �scan_tag)r r r r
rR o s zScanner.fetch_tagc C s | j dd� d S )Nr7 )�style)�fetch_block_scalar)r r r r
rS z s zScanner.fetch_literalc C s | j dd� d S )Nr8 )rr )rs )r r r r
rT } s zScanner.fetch_foldedc C s$ d| _ | �� | j�| �|�� d S )NT)r r^ r ra �scan_block_scalar)r rr r r r
rs � s zScanner.fetch_block_scalarc C s | j dd� d S )Nr9 )rr )�fetch_flow_scalar)r r r r
rU � s zScanner.fetch_singlec C s | j dd� d S )Nr: )rr )ru )r r r r
rV � s zScanner.fetch_doublec C s$ | � � d| _| j�| �|�� d S )NF)r` r r ra �scan_flow_scalar)r rr r r r
ru � s zScanner.fetch_flow_scalarc C s" | � � d| _| j�| �� � d S )NF)r` r r ra �
scan_plain)r r r r
rX � s zScanner.fetch_plainc C s | j dkrdS d S )Nr T)r )r r r r
r? � s
zScanner.check_directivec C s. | j dkr*| �d�dkr*| �d�dkr*dS d S )Nr rf z---u
T)r �prefixr= )r r r r
rA � s
z Scanner.check_document_startc C s. | j dkr*| �d�dkr*| �d�dkr*dS d S )Nr rf z...u
T)r rx r= )r r r r
rC � s
zScanner.check_document_endc C s | � d�dkS )Nr u
)r= )r r r r
rJ � s zScanner.check_block_entryc C s | j r
dS | �d�dkS d S )NTr u
)r r= )r r r r
rL � s zScanner.check_keyc C s | j r
dS | �d�dkS d S )NTr u
)r r= )r r r r
rN � s zScanner.check_valuec C s6 | � � }|dkp4| � d�dko4|dkp4| j o4|dkS )Nu
-?:,[]{}#&*!|>'"%@`r u
r, z?:)r= r )r rZ r r r
rW � s zScanner.check_plainc C s� | j dkr | �� dkr | �� d}xb|s�x| �� dkr@| �� q*W | �� dkrhx| �� dkrf| �� qPW | �� r~| js�d| _q$d}q$W d S )Nr u F� �#u
T)r r= rg �scan_line_breakr r )r �foundr r r
r; � s zScanner.scan_to_next_tokenc C s� | � � }| �� | �|�}d }|dkr:| �|�}| � � }n>|dkrV| �|�}| � � }n"| � � }x| �� dkrv| �� q`W | �|� t||||�S )NZYAMLZTAGu
)rY rg �scan_directive_name�scan_yaml_directive_value�scan_tag_directive_valuer= �scan_directive_ignored_lineZDirectiveToken)r ri �name�valuerj r r r
rd s
zScanner.scan_directivec C s� d}| � |�}x`d| kr$dksZn d| kr:dksZn d| krPdksZn |dkrn|d 7 }| � |�}qW |s�td
|d | | �� ��| �|�}| �|� | � � }|d kr�td
|d | | �� ��|S )
Nr �0�9�A�Z�a�zz-_r zwhile scanning a directivez6expected alphabetic or numeric character, but found %ru
)r= r rY rx rg )r ri �lengthrZ r� r r r
r} & s$
D
zScanner.scan_directive_namec C s� x| � � dkr| �� qW | �|�}| � � dkrJtd|d| � � | �� ��| �� | �|�}| � � dkr�td|d| � � | �� ��||fS )Nry r- zwhile scanning a directivez%expected a digit or '.', but found %ru
z%expected a digit or ' ', but found %r)r= rg �scan_yaml_directive_numberr rY )r ri �major�minorr r r
r~ ; s
z!Scanner.scan_yaml_directive_valuec C s� | � � }d| kr dks4n td|d| | �� ��d}x*d| � |� krTdkrbn n
|d7 }q:W t| �|��}| �|� |S )Nr� r� zwhile scanning a directivez expected a digit, but found %rr r )r= r rY �intrx rg )r ri rZ r� r� r r r
r� L s
z"Scanner.scan_yaml_directive_numberc C sP x| � � dkr| �� qW | �|�}x| � � dkr<| �� q&W | �|�}||fS )Nry )r= rg �scan_tag_directive_handle�scan_tag_directive_prefix)r ri �handlerx r r r
r Y s
z Scanner.scan_tag_directive_valuec C s6 | � d|�}| �� }|dkr2td|d| | �� ��|S )N� directivery zwhile scanning a directivezexpected ' ', but found %r)�scan_tag_handler= r rY )r ri r� rZ r r r
r� c s z!Scanner.scan_tag_directive_handlec C s6 | � d|�}| �� }|dkr2td|d| | �� ��|S )Nr� u
zwhile scanning a directivezexpected ' ', but found %r)� scan_tag_urir= r rY )r ri r� rZ r r r
r� l s z!Scanner.scan_tag_directive_prefixc C sr x| � � dkr| �� qW | � � dkr@x| � � dkr>| �� q(W | � � }|dkrftd|d| | �� ��| �� d S )Nry rz u
zwhile scanning a directivez0expected a comment or a line break, but found %r)r= rg r rY r{ )r ri rZ r r r
r� u s z#Scanner.scan_directive_ignored_linec C s
| � � }| �� }|dkr d}nd}| �� d}| �|�}x`d| krNdks�n d| krddks�n d | krzd
ks�n |d kr�|d 7 }| �|�}q:W |s�td
| |d| | � � ��| �|�}| �|� | �� }|dkr�td
| |d| | � � ��| � � }||||�S )Nr �alias�anchorr r� r� r� r� r� r� z-_r zwhile scanning an %sz6expected alphabetic or numeric character, but found %ru
?:,]}%@`)rY r= rg r rx ) r rh ri Z indicatorr� r� rZ r� rj r r r
rp � s2
D
zScanner.scan_anchorc C s& | � � }| �d�}|dkrdd }| �d� | �d|�}| �� dkrZtd|d| �� | � � ��| �� n~|dkr~d }d }| �� ndd}d
}x,|d kr�|d kr�d }P |d7 }| �|�}q�W d }|r�| �d|�}n d }| �� | �d|�}| �� }|d k�r
td
|d| | � � ��||f}| � � }t|||�S )Nr �<� �tagr8 zwhile parsing a tagzexpected '>', but found %ru
r6 Fu
Tzwhile scanning a tagzexpected ' ', but found %r)rY r= rg r� r r� ZTagToken) r ri rZ r� �suffixr� Z
use_handler� rj r r r
rq � sH
zScanner.scan_tagc C s� |dkrd}nd}g }| � � }| �� | �|�\}}| �|� | jd }|dk rTd}|d krv| �� \}} }
t|| �} n|| d } | �| �\}}
d} x�| j| k�rv| � � dk�rv|�
|� | � � dk}
d}x| � |�d kr�|d7 }q�W |� | � |�� | �|� | �
� } | �| �\}}
| j| k�rr| � � dk�rr|�rf| d
k�rf|
�rf| � � dk�rf|�sp|� d � n
|� | � q�P q�W |dk �r�|� | � |dk�r�|�
|� td�|�d||
|�S ) Nr8 TFr � r* z r u
�
ry )rY rg � scan_block_scalar_indicators� scan_block_scalar_ignored_liner � scan_block_scalar_indentation�max�scan_block_scalar_breaksr r= �extendra rx r{ � ScalarToken�join)r rr �folded�chunksri �chomping� incrementZ
min_indent�breaks�
max_indentrj r �
line_breakZleading_non_spacer� r r r
rt � sP
zScanner.scan_block_scalarc C s� d }d }| � � }|dkrn|dkr&d}nd}| �� | � � }|dkr�t|�}|dkrdtd|d| �� ��| �� n\|dkr�t|�}|dkr�td|d| �� ��| �� | � � }|dkr�|dkr�d}nd}| �� | � � }|d kr�td|d
| | �� ��||fS ) Nz+-�+TF�
0123456789r z while scanning a block scalarz| �� q(W | � � }|dkrftd|d| | �� ��| �� d S )Nry rz u
z while scanning a block scalarz0expected a comment or a line break, but found %r)r= rg r rY r{ )r ri rZ r r r
r� D s
z&Scanner.scan_block_scalar_ignored_linec C sh g }d}| � � }xL| �� dkr\| �� dkrB|�| �� � | � � }q| �� | j|kr| j}qW |||fS )Nr u
ry )rY r= ra r{ rg r )r r� r� rj r r r
r� R s
z%Scanner.scan_block_scalar_indentationc C s� g }| � � }x"| j|k r.| �� dkr.| �� qW xJ| �� dkrz|�| �� � | � � }x"| j|k rv| �� dkrv| �� qVW q2W ||fS )Nry u
)rY r r= rg ra r{ )r r r� rj r r r
r� a s z Scanner.scan_block_scalar_breaksc C s� |dkrd}nd}g }| � � }| �� }| �� |�| �||�� x4| �� |krt|�| �||�� |�| �||�� qBW | �� | � � }td�|�d|||�S )Nr: TFr� )rY r= rg r� �scan_flow_scalar_non_spaces�scan_flow_scalar_spacesr� r� )r rr �doubler� ri �quoterj r r r
rv n s zScanner.scan_flow_scalarr* ��� r� � � �
�ry r: �\�/�
� u
u
)r� r� �b�tr� �n�v�f�r�ery r: r� r� �N�_�L�Pr� � � )�x�u�Uc C s� g }�x�d}x| � |�dkr&|d7 }qW |rF|�| �|�� | �|� | � � }|s~|dkr~| � d�dkr~|�d� | �d� q|r�|dks�|s�|dkr�|�|� | �� q|�r�|dk�r�| �� | � � }|| jkr�|�| j| � | �� n�|| jk�rz| j| }| �� xBt|�D ]6}| � |�dk�rtd |d
|| � |�f | �� ���qW t | �|�d �}|�t
|�� | �|� n<|d k�r�| � � |� | �
||�� ntd |d
| | �� ��q|S qW d S )Nr u '"\
r r9 r� z"\r� �0123456789ABCDEFabcdefz%while scanning a double-quoted scalarz?expected escape sequence of %d hexdecimal numbers, but found %r� u
z!found unknown escape character %r)r= ra rx rg �ESCAPE_REPLACEMENTS� ESCAPE_CODES�ranger rY r� �chrr{ r� �scan_flow_scalar_breaks)r r� ri r� r� rZ �k�coder r r
r� � sL
z#Scanner.scan_flow_scalar_non_spacesc C s� g }d}x| � |�dkr"|d7 }q
W | �|�}| �|� | � � }|dkr\td|d| �� ��nT|dkr�| �� }| �||�}|dkr�|�|� n|s�|�d � |�|� n
|�|� |S )
Nr z r r* z while scanning a quoted scalarz found unexpected end of streamu
r� ry ) r= rx rg r rY r{ r� ra r� ) r r� ri r� r� � whitespacesrZ r� r� r r r
r� � s(
z Scanner.scan_flow_scalar_spacesc C s� g }xx| � d�}|dks |dkr@| �d�dkr@td|d| �� ��x| �� dkrX| �� qBW | �� dkrv|�| �� � q|S qW d S ) Nrf z---z...u
z while scanning a quoted scalarz#found unexpected document separatorz u
)rx r= r rY rg ra r{ )r r� ri r� rx r r r
r� � s
z Scanner.scan_flow_scalar_breaksc C s g }| � � }|}| jd }g }x�d}| �� dkr2P xV| �|�}|dks||dkrn| �|d �d| jrfdnd ks|| jr~|dkr~P |d7 }q4W |dkr�P d | _|�|� |�| �|�� | �|� | � � }| � ||�}|r�| �� dks�| js | j
|k r P q W t d� |�d
||�S ) Nr r rz u
r4 z,[]{}r� z,?[]{}FT)
rY r r= r r r� ra rx rg �scan_plain_spacesr r� r� )r r� ri rj r �spacesr� rZ r r r
rw � s<
zScanner.scan_plainc
C s. g }d}x| � |�dkr"|d7 }q
W | �|�}| �|� | � � }|dk�r| �� }d| _| �d�}|dksr|dkr�| � d�d kr�d S g } x`| � � d
kr�| � � dkr�| �� q�| �| �� � | �d�}|dks�|dkr�| � d�d kr�d S q�W |d kr�|�|� n| �s|�d� |�| � n|�r*|�|� |S ) Nr ry r u
Trf z---z...u
u
r� )r= rx rg r{ r ra r� )
r r ri r� r� r� rZ r� rx r� r r r
r� s>
zScanner.scan_plain_spacesc C s� | � � }|dkr*td| |d| | �� ��d}| � |�}|dkr�x`d| krVdks�n d| krld ks�n d
| kr�d ks�n |d kr�|d7 }| � |�}qBW |dkr�| �|� td| |d| | �� ��|d7 }| �|�}| �|� |S )
Nr6 zwhile scanning a %szexpected '!', but found %rr ry r� r� r� r� r� r� z-_)r= r rY rg rx )r r� ri rZ r� r� r r r
r� D s&
D
zScanner.scan_tag_handlec C s� g }d}| � |�}x�d| kr(dks^n d| kr>dks^n d| krTdks^n |dkr�|d kr�|�| �|�� | �|� d}|�| �||�� n|d
7 }| � |�}qW |r�|�| �|�� | �|� d}|s�td | |d | | �� ��d
�|�S )Nr r� r� r� r� r� r� z-;/?:@&=+$,_.!~*'()[]%r+ r zwhile parsing a %szexpected URI, but found %rr� )r= ra rx rg �scan_uri_escapesr rY r� )r r� ri r� r� rZ r r r
r� \ s(
D
zScanner.scan_tag_uric
C s� g }| � � }xx| �� dkr�| �� x>td�D ]2}| �|�dkr,td| |d| �|� | � � ��q,W |�t| �d�d�� | �d� qW yt|�� d�}W n8 t
k
r� } ztd| |t |�|��W d d }~X Y nX |S )Nr+ r� r� zwhile scanning a %szBexpected URI escape sequence of 2 hexdecimal numbers, but found %rr� zutf-8) rY r= rg r� r ra r� rx �bytes�decode�UnicodeDecodeError�str)r r� ri �codesr r� r� �excr r r
r� u s
(zScanner.scan_uri_escapesc C sN | � � }|dkr6| �d�dkr*| �d� n| �� dS |dkrJ| �� |S dS )Nu
r� z
r� u
r� )r= rx rg )r rZ r r r
r{ � s zScanner.scan_line_breakN)Lr r r r r$ r% r' r r r) r( r` r^ r< rb r r> r@ rB rD re rE rF rk rG rH rl rI rK rM rO rP rQ rR rS rT rs rU rV ru rX r? rA rC rJ rL rN rW r; rd r} r~ r� r r� r� r� rp rq rt r� r� r� r� rv r� r� r� r� r� rw r� r� r� r� r{ r r r r
r . s� A
l
! 8
#
$)L(
+)%N)�__all__�errorr r r r r r r r r
� s