File: //usr/lib64/python3.9/site-packages/borg/helpers/__pycache__/misc.cpython-39.pyc
a
HZ�h�! � @ sN d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZmZ d dl m Z m
Z
m Z d dl m
Z
d dlmZ ddlmZ e� Zdd lmZ dd
lmZ dd lmZ dd lmZ dd
lmZmZ dd� Z eg d��Z d)dd�Z dd� Z e j ed�dd�Z!dd� Z"G dd� d�Z#d d � Z$d d � Z%d*d d!�Z&G d"d#� d#ej'�Z(d+d%d&�Z)d'd(� Z*dS ),� N)�deque� OrderedDict)�datetime�timezone� timedelta)�islice)�
attrgetter� )�
create_logger� )� to_localtime)�msgpack)� __version__)�chunker)�
CH_BUZHASH�CH_FIXEDc C sZ t �tj�t|d d� }d}g }| D ].}|j|kr&|d7 }d|f||j< |�|� q&|S )Ni )Zsecondsr r Zwithin)r Znowr Zutcr �ts�id�append)�archivesZhours� kept_because�targetZ kept_counter�result�a� r �7/usr/lib64/python3.9/site-packages/borg/helpers/misc.py� prune_within s
r ))Zsecondlyz%Y-%m-%d %H:%M:%S)Zminutelyz%Y-%m-%d %H:%M)Zhourlyz %Y-%m-%d %H)Zdailyz%Y-%m-%d)Zweeklyz%G-%V)Zmonthlyz%Y-%m)Zyearlyz%Yc C s� d }g }t | }|d u r i }|dkr(|S d }t| td�dd�D ]V}t|j��|�}||kr>|}|j|vr>|�|� |t|�f||j< t|�|kr> q�q>|d ur�t|�|k r�|j|vr�|�|� |d t|�f||j< |S )Nr r T)�key�reversez[oldest]) �PRUNING_PATTERNS�sortedr r r �strftimer r �len) r Zrule�nr �lastZkeep�patternr Zperiodr r r � prune_split- s*
r& c C s~ t j�dd��� } | dkr dS t�� }t�� }z t �� }W n tyP d }Y n0 t j�
d�rdd}nd }zd� dd � t j
D ��}W n d
}Y n0 d d lm}m} |r�|jnd
}|r�d|j nd} |� | � d|� d�}
g } |d ur�| �d�d� |��� |d u�r| �d| � | �d�t||||
�� | �dt �� t �� f � | �dt j � | �dt j�d� � | �d� d� | �S )NZBORG_SHOW_SYSINFOZyes�no� Zlinux)z
Unknown Linuxr( r( �.c s s | ]}t |�V qd S �N)�str)�.0�vr r r � <genexpr>Y � zsysinfo.<locals>.<genexpr>�unknownr )�llfuse�BORG_FUSE_IMPL�Nonez %sz [�]z Platform: {}� zLinux: %s %s %sz,Borg: {} Python: {} {} msgpack: {} fuse: {}zPID: %d CWD: %sz sys.argv: %rzSSH_ORIGINAL_COMMAND: %rZSSH_ORIGINAL_COMMAND�
)�os�environ�get�lower�platform�python_implementation�python_version�uname�AttributeError�sys�
startswith�joinr
�versionZ fuse_implr1 r2 �__name__r r �format� borg_version�getpid�getcwd�argv) Z show_sysinfor< r= r> Zlinux_distributionZmsgpack_versionr1 r2 Z llfuse_nameZllfuse_versionZ llfuse_info�infor r r �sysinfoG sB
�
rK )�level�loggerc G s6 g }|D ]}|� |�� � q|D ]}|�| |� q dS )z�
log multiple lines of text, each line by a separate logging call for cosmetic reasons
each positional argument may be a single or multiple lines (separated by newlines) of text.
N)�extend�
splitlines�log)rL rM Zmsgs�lines�msg�liner r r � log_multin s
rT c C s` t | ttf�sJ �t | t�r$t| �} t| �dkrHt | d t�rHtf| } | d ttfv s\J �| S )N� r )�
isinstance�list�tupler" �intr r )Zcpr r r �normalize_chunker_params{ s
rZ c @ s2 e Zd ZdZd dd�Zdd� Zdd� Zd d
� ZdS ) �ChunkIteratorFileWrapperz%File-like wrapper for chunk iteratorsNc C s" || _ d| _d| _d| _|| _dS )at
*chunk_iterator* should be an iterator yielding bytes. These will be buffered
internally as necessary to satisfy .read() calls.
*read_callback* will be called with one argument, some byte string that has
just been read and will be subsequently returned to a caller of .read().
It can be used to update a progress display.
r r/ FN)�chunk_iterator� chunk_offset�chunk� exhausted�
read_callback)�selfr\ r` r r r �__init__� s
z!ChunkIteratorFileWrapper.__init__c C s\ t | j�| j }|sXzt| j�}t|�| _W n tyF d| _Y dS 0 d| _t | j�}|S )NTr )r" r^ r] �nextr\ �
memoryview�
StopIterationr_ )ra � remainingr^ r r r �_refill� s
z ChunkIteratorFileWrapper._refillc C s> |sdS | � � }t||�}| j|7 _| j| j| | j� S �Nr/ )rg �minr] r^ )ra �nbytesrf Z will_readr r r �_read� s
z ChunkIteratorFileWrapper._readc C sJ g }|r@| j s@| �|�}|t|�8 }|�|� | jr| �|� qd�|�S rh )r_ rk r" r r` rB )ra rj �partsZ read_datar r r �read� s
z ChunkIteratorFileWrapper.read)N)rD �
__module__� __qualname__�__doc__rb rg rk rm r r r r r[ � s
r[ c C s | j �dd� |jD ��}t|�S )z8Return file-like object for archived item (with chunks).c S s g | ]
}|j �qS r )r )r, �cr r r �
<listcomp>� r/ z open_item.<locals>.<listcomp>)ZpipelineZ
fetch_many�chunksr[ )�archive�itemr\ r r r � open_item� s rv c s t | �� t � �fdd�g �S )z�
Chunk an iterator <it> into pieces of <size>.
>>> list(chunker('ABCDEFG', 3))
[['A', 'B', 'C'], ['D', 'E', 'F'], ['G']]
c s t t� ���S r* )rW r r ��iterable�sizer r �<lambda>� r/ zchunkit.<locals>.<lambda>)�iter)�itry r rw r �chunkit� s r} c C s, |du rt | dd� ntt| ||�d� dS )zCAdvance the iterator n-steps ahead. If n is none, consume entirely.Nr )�maxlen)r rc r )�iteratorr# r r r �consume� s r� c s( e Zd Z� fdd�Z� fdd�Z� ZS )�ErrorIgnoringTextIOWrapperc sN | j sJzt� �|�W S tyH zt� �� W n tyB Y n0 Y n0 dS )Nr( )�closed�superrm �BrokenPipeError�close�OSError)ra r# �� __class__r r rm � s z ErrorIgnoringTextIOWrapper.readc sR | j sJzt� �|�W S tyH zt� �� W n tyB Y n0 Y n0 t|�S r* )r� r� �writer� r� r� r" )ra �sr� r r r� � s z ErrorIgnoringTextIOWrapper.write)rD rn ro rm r� �
__classcell__r r r� r r� � s r� � c c s� | � |�}t|t�}|r dnd}|p.|r,dnd}t|�dkrv|�|�^}}|| g|�R �^ }}|E dH | � |�}q0t|�dkr�|V dS )zHIter over chunks of open file ``fd`` delimited by ``sep``. Doesn't trim.r( r/ r6 �
r N)rm rV r+ r" �split) �fd�sepZ read_size�bufZis_str�partZpart2�itemsZfullr r r �iter_separated� s
r� c C s� | � d�r|rdnd}nd| � d�r0|r*dnd}nL| � d�rH|rBdnd }n4| � d
�r`|rZd nd }n | � d
�rx|rrdnd}nd }t�d|� |S )N)z.tar.gzz.tgzzgzip -d�gzip)z.tar.bz2z.tbzzbzip2 -d�bzip2)z.tar.xzz.txzzxz -d�xz)z.tar.lz4zlz4 -dZlz4)z .tar.zstdz.tar.zstzzstd -dZzstdz'Automatically determined tar filter: %s)�endswithrM �debug)�fname�
decompress�filterr r r �get_tar_filter� s
r� )N)N)Nr� )+Zlogging�ior7 Zos.pathr; r@ � collectionsr r r r r � itertoolsr �operatorr rM r
�timer r( r
r rF r Z constantsr r r r r& rK �INFOrT rZ r[ rv r} r� �
TextIOWrapperr� r� r� r r r r �<module> s:
'
2