3
\�2 � @ s� d dl Z d dlZd dlZd dlmZ d dlmZ dddgZG dd� d�Zdd
d�Z ej
d ej �j Z
d d� Zd
d� Zedkr�eej�dkr�ee� � n,ejd Zee��Zeeee�� W dQ R X dS )� N)�deque)�StringIO�shlex�split�quotec @ sb e Zd Zddd�Zdd� Zddd�Zd d
� Zd d � Zd
d� Zdd� Z ddd�Z
dd� Z dd� Z dS )r NFc C s t |t�rt|�}|d k r(|| _|| _ntj| _d | _|| _|rHd | _nd| _d| _ d| _
| jrn| j
d7 _
d| _ d| _ d| _
d| _d | _d
| _t� | _d | _d | _d| _t� | _d | _|s�d}n |d
kr�d}|| _|�rt� | _| j
d7 _
| j
jtj |��}| j
j |�| _
d S )N� �#Z?abcdfeghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789_u| ßàáâãäåæçèéêëìíîïðñòóôõöøùúûüýþÿÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖØÙÚÛÜÝÞz
Fz'"�\�"� � r Tz();<>|&z~-./*?=) �
isinstance�strr �instream�infile�sys�stdin�posix�eof�
commenters� wordchars�
whitespace�whitespace_split�quotes�escape�
escapedquotes�stater �pushback�lineno�debug�token� filestack�source�punctuation_chars�_pushback_chars� maketrans�dict�fromkeys� translate)�selfr r r r# �t� r+ � /usr/lib64/python3.6/shlex.py�__init__ sJ
zshlex.__init__c C s* | j dkrtdt|� � | jj|� d S )Nr zshlex: pushing token )r �print�reprr �
appendleft)r) �tokr+ r+ r, �
push_tokenD s
zshlex.push_tokenc C sp t |t�rt|�}| jj| j| j| jf� || _|| _d| _| jrl|d k r\t d| jf � nt d| jf � d S )Nr zshlex: pushing to file %szshlex: pushing to stream %s)
r
r r r! r0 r r r r r. )r) � newstream�newfiler+ r+ r, � push_sourceJ s
zshlex.push_sourcec C sD | j j� | jj� \| _| _ | _| jr:td| j | jf � d| _d S )Nz shlex: popping to %s, line %dr ) r �closer! �popleftr r r r. r )r) r+ r+ r, �
pop_sourceX s
zshlex.pop_sourcec C s� | j r.| j j� }| jdkr*tdt|� � |S | j� }| jd k r~x<|| jkr|| j| j� �}|rr|\}}| j||� | j � }qBW x*|| j
kr�| j s�| j
S | j � | j � }q�W | jdkr�|| j
kr�tdt|� � ntd� |S )Nr zshlex: popping token z
shlex: token=zshlex: token=EOF)
r r7 r r. r/ �
read_tokenr" �
sourcehookr5 � get_tokenr r! r8 )r) r1 �raw�specr4 r3 r+ r+ r, r; a s.
zshlex.get_tokenc C s� d}d}�x\| j r$| jr$| jj� }n | jjd�}|dkrF| jd7 _| jdkrbtd| j|f � | jd krvd| _ P q | jdk�r�|s�d | _P �qd|| j
kr�| jdkr�td � | j s�| j r |r P nq n�|| j kr�| jj
� | jd7 _n�| j o�|| jk�rd
}|| _n�|| jk�r"|| _ d
| _np|| j k�r<|| _ d | _nV|| jk�r^| j �sV|| _ || _n4| j�rt|| _ d
| _n || _ | j �s�| j r |r P nq q | j| jk�r| j �r,|| jk�r,| j| jk�r,| j}|| _n| j |7 _ q | j| jk�r�|�sl| jdk�rdtd� td��|| jk�r�|| jk�r�||k�r�| j | j7 _ | j |7 _ || _q | jdkr |�s�d | _P q || j
k�r| jdk�r�td� d| _| j �s| j r |r P nq q || j k�rZ| jj
� | jd7 _| j �rdd| _| j �sR| j r |r P nq q | jd k�r�|| j k�r�| j |7 _ n || j
k�r�| jj|� d| _P q | j �r�|| jk�r�|| _q | j �r�|| jk�r�d
}|| _q || jk�s || jk�s | j�r| j |7 _ q | j �r&| jj|� n | jj|� | jdk�rFtd� d| _| j �s^| j r |r P q q q W | j }d| _ | j �r�| �r�|dk�r�d }| jdk�r�|�r�tdt|� � ntd� |S )NFr r �
� z&shlex: in state %r I see character: %rr � z+shlex: I see whitespace in whitespace state�a�cTz shlex: I see EOF in quotes statezNo closing quotationz shlex: I see EOF in escape statezNo escaped characterz%shlex: I see whitespace in word statez&shlex: I see punctuation in word statezshlex: raw token=zshlex: raw token=EOF)rA rB )r# r$ �popr �readr r r. r r r r r �readliner r r r �
ValueErrorr �appendr r0 r/ )r) ZquotedZ escapedstateZnextchar�resultr+ r+ r, r9 � s�
zshlex.read_tokenc C sX |d dkr|dd� }t | jt�rJtjj|� rJtjjtjj| j�|�}|t|d�fS )Nr r
r �r�����) r
r r �os�path�isabs�join�dirname�open)r) r4 r+ r+ r, r: s
zshlex.sourcehookc C s( |d kr| j }|d kr | j}d||f S )Nz"%s", line %d: )r r )r) r r r+ r+ r, � error_leader s
zshlex.error_leaderc C s | S )Nr+ )r) r+ r+ r, �__iter__# s zshlex.__iter__c C s | j � }|| jkrt�|S )N)r; r �
StopIteration)r) r r+ r+ r, �__next__& s
zshlex.__next__)NNFF)N)NN)
�__name__�
__module__� __qualname__r- r2 r5 r8 r; r9 r: rQ rR rT r+ r+ r+ r, r s
.
FTc C s$ t | |d�}d|_|s d|_t|�S )N)r Tr )r r r �list)�sZcommentsr Zlexr+ r+ r, r , s
z[^\w@%+=:,./-]c C s, | sdS t | �d kr| S d| jdd� d S )Nz''�'z'"'"')� _find_unsafe�replace)rY r+ r+ r, r 6 s
c C s( x"| j � }|sP tdt|� � qW d S )NzToken: )r; r. r/ )ZlexerZttr+ r+ r, �
_print_tokensB s
r] �__main__r )FT)rK �rer � collectionsr �ior �__all__r r �compile�ASCII�searchr[ r r] rU �len�argv�fnrP �fr+ r+ r+ r, �
s$