/
lib64
/
python3.9
/
site-packages
/
mercurial
/
revlogutils
/
__pycache__
/
New Directory
Upload File
HOME
a �+�b@s � @ sX d dl Z d dlZd dlZd dlZddlmZ ddlmZmZm Z m Z m Z m Z m Z mZmZmZmZmZmZmZmZmZ ddlmZ ddlmZmZm Z m Z m Z ddl m Z dd lmZm!Z! d0d d �Z"d1d d�Z#d2dd�Z$dd� Z%dd� Z&dd� Z'dd� Z(dd� Z)dd � Z*d d � Z+d d � Z,d3d!d"�Z-d4d#d$�Z.d%d&� Z/d'd(� Z0d)d*� Z1d+d,� Z2d5d.d/�Z3dS )6� N� )�nullrev� )�COMP_MODE_PLAIN� ENTRY_DATA_COMPRESSED_LENGTH�ENTRY_DATA_COMPRESSION_MODE�ENTRY_DATA_OFFSET� ENTRY_DATA_UNCOMPRESSED_LENGTH�ENTRY_DELTA_BASE�ENTRY_LINK_REV� ENTRY_NODE_ID�ENTRY_PARENT_1�ENTRY_PARENT_2� ENTRY_SIDEDATA_COMPRESSED_LENGTH� ENTRY_SIDEDATA_COMPRESSION_MODE�ENTRY_SIDEDATA_OFFSET�REVIDX_ISCENSORED�REVLOGV0�REVLOGV1)�_)�error�mdiff�pycompat� revlogutils�util)� storageutil)� constants�deltas� c C s� | j tjksJ | j ��ddlm} | �|�}t�d|id�}|j| j| j | j ddd�}| j |_ | j |_ | j |_ | j |_ | �� D ]�}| �|�}| �|�\} } ||kr�|�||| �|�| | |tj� |�|�tkr~td�} td �} tj| | d ��q~| �|��r(| �|�tk�r td �} t�| ��| �|�} n | �|�} |�| || �|�| | || � |�� q~|j | j d d � | j �s~|j | j d d � | j�!|j | j � | j �s�| j�!|j | j � | �"� | �#� dS )z*censors a revision in a "version 1" revlogr )�revlog� censoredr s tmpcensoredT)�target�radixZpostfixZ censorables0 censored revision stored as delta; cannot censorsE censoring of revlogs is not fully implemented; please report this bug)�hints: cannot censor due to censored revision having delta storeds store)�locationN)$�_format_versionr r � r �revr �packmeta�openerr! r" Z _format_flagsZ _generaldeltaZ _parse_index�revs�node�parentsZaddrawrevisionZlinkrevr � deltaparentr r r �Abort� iscensored�_chunk�rawdata�flagsZ addbackup� _indexfile�_inlineZ _datafile�rename� clearcaches� _loadindex)�rl�tr� censornode� tombstoner Z censorrevZnewrlr' r+ �p1�p2�m�hZrawtext� r@ �C/usr/lib64/python3.9/site-packages/mercurial/revlogutils/rewrite.py� v1_censor6 sl � � � � �rB c C sF | j tksJ | j ��| j tks(J | j ��| �|�h}t| |||� dS )z*censors a revision in a "version 2" revlogN)r% r r r' � _rewrite_v2)r r9 r: r; � censor_revsr@ r@ rA � v2_censor� s rE c C sJ | j tksJ | j ��| j tks(J | j ��| j}| j}t�d|id�}t|�}| j| }| jj| }|t d? } | � |�} t j dd���} t | ||| �} t| || | �} | � �^}|\}}}}}t|t|��D ]0}||v r�t| ||||� q�t| |||| | � q�W d � n1 �s0 Y W d � n1 �s.0 Y |jddd� dS ) a[ rewrite a revlog to censor some of its content General principle We create new revlog files (index/data/sidedata) to copy the content of the existing data without the censored data. We need to recompute new delta for any revision that used the censored revision as delta base. As the cumulative size of the new delta may be large, we store them in a temporary file until they are stored in their final destination. All data before the censored data can be blindly copied. The rest needs to be copied as we go and the associated index entry needs adjustement. r r � s w+b��modeNT)Z transactionZ stripping)r% r r �index�_docketr r( �minZ entry_sizer Zsidedata_cut_offr Zunnamedtempfile�_precompute_rewritten_delta�_setup_new_files�range�len�_rewrite_censor�_rewrite_simple�write)r r9 rD r; � old_index�docket�first_excl_revZfirst_excl_entry� index_cutoff� data_cutoff�sidedata_cutoff� tmp_storage�rewritten_entries� all_filesZ open_files� old_data_file�old_sidedata_file�new_index_file� new_data_file�new_sidedata_filer' r@ r@ rA rC � sb �� ���FrC c C sB t �| �}i }t|�}| j�� �� }t|t|��D ]�}||v r@q2|| } | t |vrVq2| t dkrtt ddt f||< q2| j ||d�} t j | t | �| t �| �| t �| gt| �d| t d@ d�} |j| |||d�} | jj} t �| | �\}} |�� }|�| jd � |�� }| j|||f||< q2W d � n1 �s40 Y |S )u� Compute new delta for revisions whose delta is based on revision that will not survive as is. Return a mapping: {rev → (new_base, data_start, data_end, compression_mode)} r )Z_dfN� )r+ r< r= Zbtext�textlenZ cachedeltar2 )Zexcluded_basesZ target_revr )r � deltacomputerrK Z _segmentfileZ _open_readrN rO r r r r r1 r � revisioninfor r+ r r r Z finddeltainforJ Zdefault_compression_headerZdelta_compression�tellrR �data�base)r rS Z excluded_revsrY ZdcrZ rU Zdfhr' �entry�text�info�dZ default_compZ comp_mode�start�endr@ r@ rA rL � s@ � �4rL c s | j }| j�|�� �}| j�|�� ��| j�|�� ��| j�|�� ��| j�|�� ��| j�|�� ��t j |��d� t j ��� d� t j ���d� | j� |�� � | j� |�� � | j� |�� � �|_ � |_ �|_| �� | j|d� tj� �������fdd��}|S )a+ return a context manager to open all the relevant files: - old_data_file, - old_sidedata_file, - new_index_file, - new_data_file, - new_sidedata_file, The old_index_file is not here because it is accessed through the `old_index` object if the caller function. )Znb_bytes)rT c 3 sF t �d���$} t �d���}t �d���}t �d���}t �d��z}|�dtj� |�� �ks\J �|�dtj� |�� � kszJ �|�dtj� |�� �ks�J �| ||||fV W d � n1 s�0 Y W d � n1 s�0 Y W d � n1 s�0 Y W d � n1 �s0 Y W d � n1 �s80 Y d S )N�rbzr+br )�open�seek�os�SEEK_ENDre )r\ r] r^ r_ r` �rW rV Znew_data_filepathZnew_index_filepathZnew_sidedata_filepathZold_data_filepathZold_sidedata_filepathrX r@ rA �all_files_openerB s( ��z*_setup_new_files.<locals>.all_files_opener)rJ r) �joinZindex_filepathZ data_filepathZsidedata_filepathr^ r_ r` r �copyfileZ register_file� index_end�data_end� sidedata_endr6 r7 � contextlib�contextmanager)r rV rW rX rT Zold_index_filepathrt r@ rs rA rM s2 � rM c C s� |\}}}} } || } | t d@ } | t d? } ||vrd|�| � | t }|�|�}| t }| t }n,|| \}}}}|| }|�|� |�|�}| �� }| �|� | t }| �� }d|k r�| t }|�|� |�|�}| �|� | t }| t }||k�sJ ||f��t j | ||||| t | t | t | t ||||d� }| j�|� | j�|�} |�| � |�� | j_| �� | j_| �� | j_dS )z@append a normal revision to the index after the rewritten one(s)ra rF r � r2 Z data_offsetZdata_compressed_length�data_uncompressed_length�data_delta_base�link_revZ parent_rev_1Z parent_rev_2Znode_idZsidedata_offsetZsidedata_compressed_lengthZdata_compression_modeZsidedata_compression_modeN)r rp r �readr r re rR r r r r r rh r r r r rI �append� entry_binaryrJ rw rx ry ) r rS r[ r' rZ rY r\ r] r^ r_ r` rh r2 Zold_data_offset� new_data_sizeZnew_datar~ Z d_comp_moderl rm �new_data_offsetZ sidedata_sizeZnew_sidedata_offsetZold_sidedata_offsetZ new_sidedatar} Z sd_com_mode� new_entry� entry_binr@ r@ rA rQ ^ st � � � rQ c C s� |\}}}}} || } t |�} |�� } |�|� | t } | t }| t }tjtj | | | || ||| t ddt t d� }| j � |� | j �|�}|�|� |�� | j_|�� | j_dS )z&rewrite and append a censored revisionr r| N)rO re rR r r r r rh r r r r rI r� r� rJ rw rx )r rS r[ r' r; r\ r] r^ r_ r` rh r� r� r r< r= r� r� r@ r@ rA rP � sD � � rP c C sF | � dd�d �dd�}t|�dk r>td�}|| ; }t�|��|d S )N� .r r � /r s, cannot recognize filelog from filename: '%s')�rsplit�splitrO r r r. )�pathZ path_part�msgr@ r@ rA � _get_filename_from_filelog_index� s r� c C s ddl m} |�| j|�}|S )zAReturns the filelog for the given `path`. Stolen from `engine.py`r )�filelog)r& r� Zsvfs)�repor� r� �flr@ r@ rA �_filelog_from_filename� s r� c C s� ddl m} | �| j�du r*d}t�|��|jj}|j| }t |�} |d |d | d< | d< |j | dd� � } |� |� |� | � dS )zASwaps p1 and p2 and overwrites the revlog entry for `rev` in `fp`r ��parsersNz*repo needs to be locked to rewrite parents� � � ) �purer� Z _currentlockZ_lockrefr �ProgrammingError� IndexObject� index_formatrI �list�packrp rR ) r� r8 r' �offset�fpr� r� r� rh r� Zpackedr@ r@ rA �_write_swapped_parents� s r� c C s� ddl m} | j}t|�dks"J �|j}|jtjkrHd|j }t� |��|j }|d }t d�} |� � ��6 �zt j|j�|�|j�|�|jd� |j|dd ���} |jr�|�| �� �} |�� D ]8} | |v r�| �| �} t| || | | � |�| | |f � q�n@|jj}|D ]2} | |j } t| || | | � |�| | |f � �qW d � n1 �sN0 Y |j� ||� |� � |� � W t � |� n t � |� 0 W d � n1 �s�0 Y d S ) z� Swaps p1 and p2 for all `to_fix` revisions of filelog `fl` and writes the new version to disk, overwriting the old one with a rename. r r� r z+expected version 1 revlog, got version '%d's .tmp-parents-fixs% repaired revision %d of 'filelog %s' )Z checkambigs r+rG N) r� r� �uirO �_revlogr% r r r r� r3 r Zuninterruptibler rv r) ru Z _checkambigr4 ZInlinedIndexObjectr� r* Z_calculate_indexr� rR r� r� �sizer5 r6 r7 Z tryunlink)r� r� �to_fixr� r� r8 r� Z index_fileZ new_file_pathZ repaired_msgr� rI r' r� r� r@ r@ rA �_reorder_filelog_parents sD � 6 r� c s* � �fdd�}� �fdd�}t ||� |�S )Nc s �j �� �S �N)r� r1 r@ ��filerevr� r@ rA �<lambda>8 r z'_is_revision_affected.<locals>.<lambda>c s �j �� �S r� )r� � parentrevsr@ r� r@ rA r� 9 r )�_is_revision_affected_inner)r� r� �metadata_cache� full_text� parent_revsr@ r� rA �_is_revision_affected7 s �r� c C sl z | � }W n t jy Y dS 0 t|dd� �dk}|durF|||< |rh|� \}}|tkrh|tkrhdS dS )a� Mercurial currently (5.9rc0) uses `p1 == nullrev and p2 != nullrev` as a special meaning compared to the reverse in the context of filelog-based copytracing. issue6528 exists because new code assumed that parent ordering didn't matter, so this detects if the revision contains metadata (since it's only used for filelog-based copytracing) and its parents are in the "wrong" order.FNr s T)r ZCensoredNodeError�bytesr )r� Z parents_revsr� r� Zraw_textZhas_metar< r= r@ r@ rA r� ? s r� c s` |j �� �fdd�}� �fdd�}� �fdd�}� �fdd�}� �fdd�}t|||||� |�S )Nc s �� � �S r� )r/ r@ �r� r8 r@ rA r� ^ r z,_is_revision_affected_fast.<locals>.<lambda>c s �� � �S r� )r- r@ r� r@ rA r� _ r c s �� � �S r� )r0 r@ r� r@ rA r� ` r c s �� � �S r� )r1 r@ r� r@ rA r� a r c s �� � �S r� )r� r@ r� r@ rA r� b r )r� � _is_revision_affected_fast_inner) r� r� r� r� � is_censored� delta_base�deltar� r� r@ r� rA �_is_revision_affected_fast\ s �r� c C s� | � rd||< dS |� \}}|t ks,|t kr0dS |� } |�| �} | du rVt||||�S |� } t| �sh| S d} t| �| k r�t�td���t�d| d| � �\} }}| dk r�t||||�}|S | ||< | S )aG Optimization fast-path for `_is_revision_affected`. `metadata_cache` is a dict of `{rev: has_metadata}` which allows any revision to check if its base has metadata, saving computation of the full text, instead looking at the current delta. This optimization only works if the revisions are looked at in order.FN� s patch cannot be decodeds >lllr ) r �getr� rO r r. r �struct�unpack)r� r� r� r� r� r� r� r< r= Z delta_parentZparent_has_metadata�chunkZ header_lengthrl Z_endZ_length� is_affectedr@ r@ rA r� n s@ � �r� c s` | � td�| � |� ��0 t|dd��� }|�� �d�D ]�}|sDq:|�dd�\}}t||�� t� fdd�|�d �D ��} t� } | D ]Z} t� | �r�d } | �| | |f � q�td �} | t � � � | ��|f; } | �| � | � | � q�| | } | �std �} | � | | � q:|s:t |� t| �� q:W d � n1 �s20 Y W d � n1 �sR0 Y d S )a Fix the revisions given in the `from_report` file, but still checks if the revisions are indeed affected to prevent an unfortunate cyclic situation where we'd swap well-ordered parents again. See the doc for `debug_fix_issue6528` for the format documentation. s loading report file '%s' rn rG � � r c 3 s | ]}� � t�|��V qd S r� )r' �binasciiZ unhexlify)�.0�n�r� r@ rA � <genexpr>� s z _from_report.<locals>.<genexpr>� ,�, found affected revision %d for filelog '%s' s) revision %s of file '%s' is not affected s* no affected revisions were found for '%s' N)rR r ro r� r� r� �setr� �warnr� �hexlifyr+ �addr� �sorted) r� r� �context� from_report�dry_run�f�lineZ filenodes�filenamer� Zexcludedr� r� r@ r� rA � _from_report� s4 � r� c # sH i }t �� ��t|t� ��D �]$\}}|\���}}��}� j�|�sZt�|� jt d���� � |�� � j���s�t��� jt d���� � ���� j���s�t��� jt d���� � ��� �fdd�}�� fdd��� fdd���� fdd�} � ������� fdd�} t |��fd d�| | ||�} | �r<���||��|f}|V q d S ) z7filter incomind deltas to repaire issue 6528 on the flys unknown parentc s t � t@ �S r� )�boolr r@ )r2 r@ rA r� � r z(filter_delta_issue6528.<locals>.<lambda>c s �� � �S r� )r' r@ )r� r r@ rA r� � r c s � S r� r@ r@ )�base_revr@ rA r� � r c s � �fS r� r@ r@ )�p1_rev�p2_revr@ rA r� � r c sd t ���� ���} t����d g| � �f��}�jd us<J ��jrN�jd }n �jd }��||�S )Nr r )r Z patchedsizer� r rd Z_writinghandlesr4 Z buildtext)rb ZrevinfoZfh)r� r� rc r2 r+ �p1_node�p2_noder r@ rA r� � s � z)filter_delta_issue6528.<locals>.full_textc s � S r� r@ r@ )r� r@ rA r� r N) r rc � enumeraterO rI Zhas_noder � LookupErrorr" r r' r� ) r Z deltas_iterr� r' rk ZlinknodeZ deltabaseZsidedatar� r� r� r� r@ ) r� r� r� rc r2 r+ r� r� r� r� r rA �filter_delta_issue6528� sb � � � � r� Fc sD ddl m� tj� ��fdd��}|r6t| �||� �S g }|� ��� t�fdd��j�� D ��}| jtd�td�t |�d �} d } |D �]\} } | � d �r�| �j @ s�q�| � � t | �} t�| �}t� }i }|�� D ]�}t�|||�}|�r&t||�}||k�r&td �}t�|�|��}t�|| |f ��|r�d }| �||| f � d} � sЈ�rf|�t�|�|��� q�|�|� q�|r�t|�}��r�|�| |f� q�t �||� q�| �r�| � td�� ��r|�rt �dd��8}|D ]"\} }|� dd� |�| f � �q�W d � n1 �s0 Y | � � W d � n1 �s60 Y d S )Nr ��storec 3 sj � s�rd V nV�� � �> ��� � d V W d � n1 s>0 Y W d � n1 s\0 Y d S r� )Zwlock�lockr@ )r� r� � to_reportr@ rA r� - s z!repair_issue6528.<locals>.contextc 3 s0 | ](\}}}|� d �r|� j@ r||fV qdS )� .iN)�endswith�FILEFLAGS_FILELOG)r� � file_typer� Z_sr� r@ rA r� ; s �z#repair_issue6528.<locals>.<genexpr>s looking for affected revisionss filelogs)Zunit�totalTr� s) paranoid check failed for '%s' at node %sr� Fs! no affected revisions were found �wbrG s %s %s r� )!r& r� rz r{ r� r� Z datafilesZ makeprogressr rO r� r� Z incrementr� r� r� r* r� r� r� r� r+ r r. r� r� r� r� r� rR ro ru Zcomplete)r� r� r� r� r� Zparanoidr� Zreport_entries�filesZprogressZ found_nothingr� r� r� r� r� r� r� ZaffectedZslowr� r+ r� r@ )r� r� r� r� rA �repair_issue6528( sr ���� � <r� )r )r )r )N)N)FNNF)4r� rz rq r� r+ r r r r r r r r r r r r r r r r r r Zi18nr r& r r r r r Zutilsr r rB rE rC rL rM rQ rP r� r� r� r� r� r� r� r� r� r� r� r@ r@ r@ rA �<module> s: H N R5JP3 0 � @(S �