3
\� � @ s� d Z dZddgZddlZddlZddlZddlZddlZddlZddl m
Z
m Z m Z m
Z
mZ G dd� de�Zd d
� Zddd�Zdd� Zdd� Zdd� Zedkr�ejee� �� dS )zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum �Driver� load_grammar� N� )�grammar�parse�token�tokenize�pgenc @ sH e Zd Zddd�Zddd�Zddd�Zdd d
�Zdd d �Zdd
d�ZdS )r Nc C s& || _ |d krtj� }|| _|| _d S )N)r �logging� getLogger�logger�convert)�selfr r
r � r �,/usr/lib64/python3.6/lib2to3/pgen2/driver.py�__init__ s
zDriver.__init__Fc C s� t j| j| j�}|j� d}d}d } } } } }
d} �xR|D �]4} | \}}}} }
|||fkr�||f|ks|t||f|f��|\}
}||
k r�| d|
| 7 } |
}d}||k r�| |
||� 7 } |}|tjtjfkr�| |7 } | \}}|j d�r@|d7 }d}q@|t
j k�rtj | }|�r,| j
jdt
j| || � |j||| |f��rT|�rR| j
jd� P d} | \}}|j d�r@|d7 }d}q@W t jd||| |f��|jS ) z4Parse a series of tokens and return the syntax tree.r r N� �
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
Zsetup�AssertionErrorr �COMMENT�NL�endswithr �OPZopmapr �debug�tok_nameZaddtokenZ
ParseErrorZrootnode)r �tokensr �p�lineno�column�type�value�start�endZ line_text�prefixZ quintupleZs_linenoZs_columnr r r � parse_tokens' sT
zDriver.parse_tokensc C s t j|j�}| j||�S )z*Parse a stream and return the syntax tree.)r �generate_tokens�readliner$ )r �streamr r r r r �parse_stream_rawW s zDriver.parse_stream_rawc C s | j ||�S )z*Parse a stream and return the syntax tree.)r( )r r' r r r r � parse_stream\ s zDriver.parse_streamc
C s* t j|d|�}z | j||�S |j� X dS )z(Parse a file and return the syntax tree.�rN)�codecs�openr) �close)r �filename�encodingr r' r r r �
parse_file` s zDriver.parse_filec C s t jtj|�j�}| j||�S )z*Parse a string and return the syntax tree.)r r% �io�StringIOr& r$ )r �textr r r r r � parse_stringh s zDriver.parse_string)NN)F)F)F)NF)F) �__name__�
__module__� __qualname__r r$ r( r) r0 r4 r r r r r s
0
c C s: t jj| �\}}|dkr d}|| djtttj�� d S )Nz.txtr �.z.pickle)�os�path�splitext�join�map�str�sys� version_info)�gt�head�tailr r r �_generate_pickle_namen s rD � Grammar.txtTFc C s� |dkrt j� }|dkr t| �n|}|s4t|| � r�|jd| � tj| �}|r�|jd|� y|j|� W q� tk
r� } z|jd|� W Y dd}~X q�X nt j
� }|j |� |S )z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r
r rD �_newer�infor Zgenerate_grammar�dump�OSErrorr �Grammar�load)rA Zgp�save�forcer �g�er r r r u s
c C s8 t jj| �sdS t jj|�s dS t jj| �t jj|�kS )z0Inquire whether file a was written since file b.FT)r9 r: �exists�getmtime)�a�br r r rF � s
rF c C sF t jj|�rt|�S tt jj|��}tj| |�}tj � }|j
|� |S )a� Normally, loads a pickled grammar by doing
pkgutil.get_data(package, pickled_grammar)
where *pickled_grammar* is computed from *grammar_source* by adding the
Python version and using a ``.pickle`` extension.
However, if *grammar_source* is an extant file, load_grammar(grammar_source)
is called instead. This facilitates using a packaged grammar file when needed
but preserves load_grammar's automatic regeneration behavior when possible.
) r9 r: �isfiler rD �basename�pkgutil�get_datar rJ �loads)�packageZgrammar_sourceZ pickled_name�datarN r r r �load_packaged_grammar� s
r[ c G sF | st jdd� } tjtjt jdd� x| D ]}t|ddd� q,W dS )z�Main program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nz %(message)s)�levelr' �formatT)rL rM )r? �argvr
Z basicConfig�INFO�stdoutr )�argsrA r r r �main� s
rb �__main__)rE NTFN)�__doc__�
__author__�__all__r+ r1 r9 r
rV r? r r r r r r �objectr rD r rF r[ rb r5 �exit�intr r r r � s$ P