3 \ �@sNddddgZdZdZdZdZdZd Zd Zd Zd Z d Z dZ dZ dZ dZdZdZdZdZdZdZdZdZdZdZdZdZdZdZd Zd!Zd"Zd#Z d$Z!d%Z"d&Z#d'Z$d(Z%d)Z&d*Z'd+Z(d,Z)d-Z*d.Z+d/Z,d0Z-d1Z.d2Z/d3Z0d4Z1d5Z2d6Z3d7Z4d8Z5d9Z6d:Z7d;Z8dZ;d?d@�e<�j=�D�Z>ej?e>j@��dAd�ZAdBd�ZBdCd�ZCdDdE�ZDeEdFk�rJeD�dGS)H�tok_name� ISTERMINAL� ISNONTERMINAL�ISEOF���������� � � � � ������������������� �!�"�#�$�%�&�'�(�)�*�+�,�-�.�/�0�1�2�3�4�5�6�7�8�9�cCs,i|]$\}}t|t�r|jd� r||�qS)�_)� isinstance�int� startswith)�.0�name�value�rG�/usr/lib64/python3.6/token.py� JsrIcCs|tkS)N)� NT_OFFSET)�xrGrGrHrOscCs|tkS)N)rJ)rKrGrGrHrRscCs|tkS)N)� ENDMARKER)rKrGrGrHrUscJCspddl}ddl}|jdd�}|r*|dp,d}d}t|�dkrF|d}y t|�}Wn@tk r�}z$|jjdt|��|j d�WYdd}~XnX|�|j �j d�}WdQRX|j d|j �}i} x:|D]2} |j| �} | r�| jdd�\} } t| �} | | | <q�Wt| j��}y t|�}WnBtk �rZ}z$|jjdt|��|j d�WYdd}~XnX|�|j �j d�}WdQRXy|jd �d}|jd �}Wn,tk �r�|jjd �|j d �YnXg}x$|D]} |jd | | | f��q�W||||�<yt|d�}WnBtk �rJ}z$|jjdt|��|j d�WYdd}~XnX|�|jdj|��WdQRXdS)NrrzInclude/token.hz Lib/token.pyzI/O error: %s � z:#define[ ][ ]*([A-Z0-9][A-Z0-9_]*)[ ][ ]*([0-9][0-9]*)rz#--start constants--z#--end constants--z&target does not contain format markersrz%s = %d�wr )�re�sys�argv�len�open�OSError�stdout�write�str�exit�read�split�compile� IGNORECASE�match�grouprB�sorted�keys�stderr�index� ValueError�append�join)rOrP�args� inFileName� outFileName�fp�err�lines�prog�tokens�liner]rE�valr`�format�start�endrGrGrH�_mainYsb          rs�__main__N)F�__all__rL�NAME�NUMBER�STRING�NEWLINE�INDENT�DEDENT�LPAR�RPAR�LSQB�RSQB�COLON�COMMA�SEMI�PLUS�MINUS�STAR�SLASH�VBAR�AMPER�LESS�GREATER�EQUAL�DOT�PERCENT�LBRACE�RBRACE�EQEQUAL�NOTEQUAL� LESSEQUAL� GREATEREQUAL�TILDE� CIRCUMFLEX� LEFTSHIFT� RIGHTSHIFT� DOUBLESTAR� PLUSEQUAL�MINEQUAL� STAREQUAL� SLASHEQUAL� PERCENTEQUAL� AMPEREQUAL� VBAREQUAL�CIRCUMFLEXEQUAL�LEFTSHIFTEQUAL�RIGHTSHIFTEQUAL�DOUBLESTAREQUAL� DOUBLESLASH�DOUBLESLASHEQUAL�AT�ATEQUAL�RARROW�ELLIPSIS�OP�AWAIT�ASYNC� ERRORTOKEN�N_TOKENSrJ�globals�itemsr�extend�valuesrrrrs�__name__rGrGrGrH�s� 5