Applications 

Synchronization of 100 Yandex disk is in progress. We save the data. Automatic synchronization with the Yandex.Disk cloud service using Link Shell Extension. Is it possible to restrict access to the Yandex.Disk folder

Matches the data on the server due to synchronization. Accordingly, if it does not work, then the meaning of use is lost software version storage facilities. Therefore, the situation needs to be corrected as soon as possible.

The way to solve the problem will depend on the cause of its occurrence. In any of the cases, you can figure out why Yandex Disk is not synchronizing on your own without spending a lot of time.

Reason 1: Synchronization is not enabled

To begin with, the most obvious thing would be to check whether synchronization is enabled in the program. To do this, click on the Yandex Disk icon and find out about its status at the top of the window. To turn it on, press the corresponding button.

Reason 2: Internet connection problems

If in the program window you see a message "Connection error", then it would be logical to check whether the computer is connected to the Internet.

To check your Internet connection, click on the icon "Net". If necessary, connect to your work network.

Please also note the status of your current connection. There should be a status here "Internet access". Otherwise, you need to contact your provider, who is obliged to solve the connection problem.

Sometimes the error may occur due to low Internet connection speed. Therefore, you need to try to start synchronization by disabling other applications that use the Internet.

Reason 3: No storage space

Perhaps your Yandex Disk has simply run out of space and there is nowhere for new files to be uploaded. To check this, go to the “cloud” page and look at its fullness scale. It is located at the bottom of the side column.

For synchronization to work, the storage must be cleared or expanded.

Reason 4: Synchronization is blocked by the antivirus

In rare cases antivirus program may block Yandex Disk synchronization. Try turning it off for a while and observe the result.

Reason 5: Individual files are not synchronized

Some files may not sync because:

  • the weight of these files is too large to be placed in storage;
  • these files are used by other programs.

In the first case, you need to take care of free space on the disk, and in the second - close all programs where the problematic file is open.

Note: files larger than 10 GB cannot be uploaded to Yandex Disk at all.

Reason 6: Blocking Yandex in Ukraine

Due to recent innovations in the legislation of Ukraine, Yandex and all its services have ceased to be available to users of this country. The operation of Yandex Disk synchronization is also in question, because... Data exchange occurs with Yandex servers. The specialists of this company are doing everything possible to solve the problem, but for now Ukrainians are forced to look for ways to bypass the blocking on their own.

You can try to resume synchronization using a VPN connection. But in this case we are not talking about numerous browser extensions - you will need separate application VPN so that connections from all applications, including Yandex Disk, are encrypted.

Error message

If none of the above methods helps, then the right thing to do is to report the problem to the developers. To do this, click on the settings icon, hover over the item "Reference" and select “Report an error to Yandex”.

You will soon receive a response from support regarding your problem.

To ensure timely changes to data in the storage, synchronization must be enabled in the Yandex Disk program. For it to work, the computer must be connected to the Internet, there must be enough space in the “cloud” for new files, and the files themselves must not be opened in other programs. If you cannot find out the cause of synchronization problems, contact Yandex support.

Recently, cloud storage services such as Yandex.Disk, Google Drive etc. They allow you to insure against the loss of important data, such as documents, photographs, etc. In principle, this is convenient, except for one point - software The service creates its own folder on the computer, with which the cloud service synchronizes, i.e., in order to send some data to the “cloud” you need to copy it to this folder. This is inconvenient for large amounts of data: so if you have, for example, 300 GB of photos, then to synchronize them you need to select and copy them to the service folder (and copying such a volume is clearly not for the faint of heart), and this process must be repeated when updating the data. But there was a solution to the problem - a symbolic link.

A symbolic (symbolic) link is a special file in the file system for which no data is generated except one text string with a pointer. This line is interpreted as the path to the file that must be opened when trying to access this link (file). A symbolic link takes up exactly as much space in the file system as is required to record its contents.

Symbolic links are used to more conveniently organize the structure of files on a computer, since they allow one file or directory to have several names and various attributes, and are also free from some of the limitations inherent in hard links (the latter are valid only within one file system(one partition) and cannot link to directories).

This is based on Wikipedia materials, and if “in Russian”, then everything that is in your directory to which the link points is also in the target directory. The symbolic link itself is widely used on Linux systems, but it is possible to create it on Windows.

You can create a link using command line, but much, much easier using the Link Shell Extension utility, which can create the required type of link.

Consider this method We will use the Yandex.Disk service as an example.

So. First you need to register in the Yandex system. Next, go to the Yandex.Disk page, download the Yandex.Disk software distribution kit to your computer and install it. An icon in the form of a flying saucer with a green checkmark or a blue circle with arrows will appear on the Taskbar near the clock.

A Yandex.Disk folder will also be created on your computer in the location you specified.

Then download the Link Shell Extension utility, install it, restart the computer and context menu, called by pressing the right mouse button, we have new line“Remember link source.”

To synchronize a folder with the “cloud”, find it on the Computer, click on it right click mouse and select “Remember link source”.

After all this, go to the Yandex.Disk folder, right-click and select “Place as -> Symbolic link”

Let's say you drew a picture kartinka.jpg on a computer disconnected from the Internet, and then uploaded a photo with the same name to Disk with mobile phone.

When you connect your computer to the Internet, Yandex.Disk will begin synchronizing. Having discovered different files with the same names, Disk will rename one of them: as a result, the files will be called kartinka.jpg and kartinka (2).jpg.

  • - all files are synchronized;
  • - synchronization is in progress;
  • - an error occurred during the synchronization process.

IN Windows Explorer the same icons are displayed for each file in the Yandex.Disk folder.

To see the speed of synchronization, hover your cursor over the Yandex.Disk icon: the upload and download speed will be indicated in a pop-up window.

Yandex.Disk determines which parts of the file have been changed and uploads only the changed fragments to the server, and not the entire file.

To save space on your computer, you can disable synchronization of individual folders. These folders will be deleted from the computer, but will remain available on the service page and in other Yandex.Disk applications.

Detailed instructions for setting up selective synchronization:

  • in the program for Windows;
  • in the Mac app.

yandex.ru

Synchronizing data on Yandex Disk

For the interaction of a local computer with the Yandex Disk cloud center, there is a term “synchronization”. An application installed on a computer is actively synchronizing something with something. Let's figure out what this process is and why it is needed.

The principle of synchronization is as follows: when you perform actions with files (editing, copying or deleting), changes occur in the cloud.

If files are changed on the Drive page, the application automatically changes them on the computer. The same changes occur on all devices connected to this account.

When downloading simultaneously different devices files with the same names, Yandex Disk will assign them a serial number (file.exe, file(2).exe, etc.).

Indication of the synchronization process in the system tray:

The same icons appear on all files and folders in the Disk directory.

The speed at which data is synchronized on Yandex disk can be found by hovering the cursor over the application icon in the tray.

It may seem strange that, for example, an archive weighing 300 MB was uploaded to Disk in a few seconds. Nothing strange, the program simply determines which fragments of the file have been changed and synchronizes only them, and not the entire archive (document).

This is very convenient if files of any current project are stored on Disk. Editing documents directly in the Drive folder saves traffic and time.

In addition, to save space on the system drive, where the cloud directory is located by default, you can disable synchronization for some folders. Such a folder is automatically deleted from the directory, but remains available in the Drive web interface and in the program settings menu.

Files in a folder with disabled synchronization are uploaded either on the service page or through the settings menu.

Of course, the application has a function complete shutdown synchronization with cloud storage.

Conclusion: the synchronization process allows you to make changes to documents at once on all devices connected using the Yandex Drive application to one account. This was done to save time and nerves of users. Synchronization saves us from the need to constantly download and upload edited files to Disk.

Not really

lumpics.ru

How to set up Yandex Disk

After registering and creating Yandex Disk, you can customize it at your discretion. Let's look at the basic settings of the program.

Setting up Yandex Disk is called by right-clicking on the program icon in the tray. Here we see a list of recently synced files and a small gear in the lower right corner. That's what we need. Click and find the “Settings” item in the drop-down context menu.

Basic

On this tab, you configure the program to launch when you log in, and enable the ability to receive news from Yandex Disk. The program folder location can also be changed.

If you are actively working with Disk, that is, you constantly access the service and perform some actions, then it is better to enable autoloading - it saves time.

Changing the location of the folder, according to the author, does not make much sense, unless you want to free up space on the system drive, and that is where the folder lies. You can transfer data to any place, even to a flash drive, however, in this case, when you disconnect the drive from the computer, the Disk will stop working.

And one more nuance: you will need to ensure that the drive letter when connecting the flash drive matches that specified in the settings, otherwise the program will not find the path to the folder.

It’s difficult to say anything about the news from Yandex Disk, since during the entire period of use, not a single news arrived.

Account

This is more of an informational tab. Here you can find your Yandex account login, information about volume consumption, and a button to disconnect your computer from Disk.

The button performs the function of exiting Yandex Disk. If you click again, you will have to re-enter your login and password. This can be convenient if there is a need to connect to another account.

Synchronization

All folders that are in the Disk directory are synchronized with the storage, that is, all files that fall into the directory or subfolders are automatically uploaded to the server.

Synchronization can be disabled for individual folders, but in this case the folder will be deleted from the computer and will remain only in the cloud. It will also be visible in the settings menu.

Autoload

Yandex Disk allows you to automatically import photos from a camera connected to your computer. In this case, the program remembers the settings profiles, and the next time you connect you will not have to configure anything.

The “Forget Devices” button unlinks all cameras from the computer.

Screenshots

On this tab you can configure hotkeys for calling various functions, type of name and file format.

The program allows you to use the standard Prt Scr key to take screenshots of the entire screen, but to take pictures of a specific area you will have to call the screenshot via a shortcut. This is very inconvenient if you need to take a screenshot of part of a window maximized to full screen (a browser, for example). This is where hotkeys come to the rescue.

You can choose any combination, the main thing is that these combinations are not occupied by the system.

Proxy

You could write a whole treatise about these settings, so we’ll limit ourselves to a short explanation.

Proxy server is a server through which client requests go to the network. It is a kind of screen between local computer and the Internet. Such servers perform different functions– from traffic encryption to protecting the client PC from attacks.

In any case, if you use a proxy and know why you need it, then configure everything yourself. If not, then it is not needed.

Additionally

This tab allows you to configure automatic installation updates, connection speed, error messages and notifications about shared folders.

Everything is clear here, I’ll only tell you about setting the speed.

Yandex Disk, when synchronizing, downloads files into several streams, occupying a fairly large part of the Internet channel. If there is a need to limit the program's appetite, then you can check this box.

Now we know where the Yandex Disk settings are and what they change in the program. You can start working.

We are glad that we were able to help you solve the problem.

Poll: did this article help you?

Not really

lumpics.ru

Selective synchronization of folders on Yandex.Disk - Disk Blog

Windows,Mac Os X,Synchronization,Programs and Applications

yandex.ru

Selective synchronization of folders on Yandex.Disk - Yandex Blog

Yandex.Disk applications for Windows and Mac OS X now have an important feature - selective synchronization. Now you can choose which folders to store on your computer and which only on Yandex.Disk. For example, if you use Yandex.Disk to store backups or archives, it is not necessary to have copies of these files on home computer. They are rarely needed, but they take up space. You can disable synchronization for folders with such files. The folders will be removed from your computer to free up space, but will remain in Drive. If you use Drive on multiple computers, you can turn individual folder syncing on one of them and turn it off on another. For example, a personal photo archive can be stored on your home computer so that it does not take up space on your work computer. And keep shared folders only on your work laptop, so that there is no temptation to work with them from home. Managing folder synchronization is available in application settings.

The Windows app also allows you to disable folder synchronization from Explorer.

At the same time, you can upload new files to a non-synced folder directly on your computer. Just drag and drop files into the desired folder in the settings window.

Follow Yandex.Disk news on our blog.

Yandex.Disk is one of the few Yandex services that includes desktop software. And one of its most important components is the algorithm for synchronizing local files with their copy in the cloud. We recently had to completely change it. If the old version had difficulty digesting even several tens of thousands of files and, moreover, did not respond quickly enough to some “complex” user actions, then the new one, using the same resources, copes with hundreds of thousands of files.

In this post I will tell you why this happened: what we could not foresee when we came up with the first version of Yandex.Disk software, and how we created a new one.

First of all, about the synchronization task itself. Technically speaking, it consists in having the same set of files in the Yandex.Disk folder on the user’s computer and in the cloud. That is, user actions such as renaming, deleting, copying, adding and changing files should be synchronized with the cloud automatically.

Why is this not as simple as it seems at first glance?

Theoretically, the task may seem quite simple, but in reality we are faced with various complex situations. For example, a person renamed a folder on his computer, we detected this and sent a command to the backend. However, none of the users wait for the backend to confirm the success of the renaming. A person immediately opens his locally renamed folder, creates a subfolder in it, and, for example, transfers some files to it. We are in a situation where it is impossible to do everything at once. necessary operations synchronization in the cloud. First you need to wait for the first operation to complete and only then can you continue.

The situation can become even more complicated if several users are working on the same account at the same time or if they have a shared folder. And this happens quite often in organizations using Yandex.Disk. Imagine that in the previous example, at the moment when we received confirmation of the first rename from the backend, another user takes and renames this folder again. In this case, it is again impossible to immediately perform the actions that the first user has already performed on his computer. The folder in which he worked locally is already called differently on the backend at this time.

There are times when a file on a user's computer cannot be named the same as it is called in the cloud. This can happen if the name contains a character that cannot be used by the local file system, or if the user is invited to shared folder, and it has its own folder with that name. In such cases, we have to use local aliases and track their association with objects in the cloud.

Previous version of the algorithm

In the previous version of Yandex.Disk desktop software, a tree comparison algorithm was used to search for changes. Any other solution at that time did not allow searching for movements and renamings, since the backend did not have unique object identifiers.

In this version of the algorithm, we used three main trees: local (Local Index), cloud (Remote Index) and the last synchronized one (Stable Index). In addition, to prevent re-generation of already queued synchronization operations, two more auxiliary trees were used: local expected and cloud expected (Expected Remote Index and Expected Local Index). These auxiliary trees stored the expected state of the local file system and the cloud, after all synchronization operations that were already queued had completed.


The procedure for comparing trees in the old algorithm looked like this:
  1. If the local wait tree and cloud wait tree are empty, initialize them by copying the last synchronized tree;
  2. We compare the local tree with the expected cloud tree and, based on the results of comparing individual nodes, add synchronization operations in the cloud to the queue (creating collections, transferring files to the cloud, moving and deleting in the cloud);
  3. For all operations that were queued in the previous step, we record their future effect in the expected cloud tree;
  4. We compare the cloud tree with the local expected one and, based on the results of comparing individual nodes, add synchronization operations with the local file system to the queue (creating directories, downloading files from the cloud, moving and deleting local files and directories);
  5. For all operations that were queued in the previous step, we record their future effect in the expected local tree;
  6. If simultaneous operations with the same file or directory fall into the queue (for example, transferring a file to the cloud and downloading the same file from the cloud), then we record a conflict - the file has changed in two places;
  7. After the synchronization operation is completed in the cloud or with the local file system, we enter its result into the last synchronized tree;
  8. When the synchronization queue becomes empty, we delete the local wait and cloud wait trees. Synchronization is complete and we will no longer need them.

Why we had to come up with a new algorithm

The main problems of the tree comparison algorithm were the high memory consumption and the need to compare entire trees even with small changes, which led to a heavy load on the processor. While processing changes to even one file, use random access memory increased by approximately 35%. Let's say a user had 20,000 files. Then, when simply renaming one file of 10 KB in size, memory consumption grew abruptly - from 116 MB to 167 MB.

We also wanted to increase the maximum number of files that a user can work with without problems. For example, a photographer who stores the results of photo sessions in Yandex.Disk may end up with several tens or even hundreds of thousands of files. This task became especially relevant when people had the opportunity to buy additional space on Yandex.Disk.

I also wanted to change some things in development. Debugging old version caused difficulties, since data on the states of one element were in different trees.

By this time, object ids appeared on the backend, with the help of which it was possible to more effectively solve the problem of detecting movements - previously we used paths.

New algorithm

We decided to change the data storage structure and replace three trees (Local Index, Remote Index, Stable Index) with one, which should have led to a reduction in redundancy in the main data structure. Due to the fact that the key in the tree is the path to the file system element, as a result of the merger, the amount of RAM used was significantly reduced.


We also stopped using auxiliary trees during synchronization, because each tree element in the new version stores all the necessary data. This change in structure made debugging the code much easier.

Since we understood that this was a major change, we created a prototype that confirmed the effectiveness of the new solution. Let's look at an example of how data in the tree changes during synchronization of a new file.

  1. After the user added a new file to the Disk folder, the program detected it and added it to the tree new element. This element has only one known state - local. Since there are no stable and remote states, memory is not allocated for them;
  2. The program uploads the file. A push comes from the cloud, confirming the appearance of a new file, and the remote state is added to the tree;
  3. The local and remote states are compared. Since they match, the stable state is added;
  4. The local and remote states are removed. They are no longer needed, since all the information is in stable.


This example shows that the new synchronization algorithm processes only those elements and events whose change data was received from the file system or the cloud, and not the entire tree, as was previously the case. Parent or child nodes will be processed as necessary (for example, if a folder is moved).

Other improvements

In the new version, we also worked on other improvements that affected performance. Tree saving has been made incremental, which allows you to write only the latest changes to the file.

Yandex.Disk uses sha256 and MD5 digests to check the integrity of files, detect changed fragments, and deduplicate files on the backend. Since this task is very CPU intensive, the implementation of digest calculations has been significantly optimized in the new version. The speed of receiving a file digest has been approximately doubled.

Numbers

Synchronization of unique 20,000 files of 10Kb each

Calculating digests of unique 20,000 files of 10kb each (indexing)

Launch with 20,000 synchronized 10Kb files

Upload 1Gb. Wi-Fi connection 10 Mbit
Time, sec

What happened

From the examples it is clear that a new version Yandex.Disk software uses about 3 times less RAM and loads the CPU about 2 times less. Processing small changes does not increase the amount of memory used.

As a result of the changes made, the number of files that the program can handle without problems has increased significantly. In the version for Windows - 300,000, and on Mac OS X - 900,000 files.