Migration without victims: technical checklist for moving the site to a new domain

Moving or migration site - an event that promises significant benefits in the long term and no less significant troubles - in the short term. Alas, it is absolutely impossible to avoid the latter, but it’s quite realistic to think in advance how and in what sequence you should deal with them.

If the slightest mention of the upcoming move makes you shiver and an inexorable desire to go to the ends of the earth, after throwing the laptop out of the window, our checklist for the move is just for you :)

1. Creating a backup

No matter how carefully you approach the move, better reinsure yourself and backup all the site files and databases using the built-in tools on the server or external additional tools.

2. Acquaintance with the history of the new domain

This item is of particular importance for those who are still thinking about moving and "feeling the ground", as well as those who bought a domain without looking. There are a number of reasons why you should treat the past of your new domain with particular attention:

1. If the previous owner managed to get banned from the search engines, it will be extremely difficult to deal with him.
2. Any kind of backlinks can lead to the site, which you will need to take into account and redirect. Moreover, backlinks can be both qualitative, and vice versa. Looking through the list of backlinks leading to the domain, you can see normal organic backlinks or explicit spam. In addition, each of the referring domains will be different indicators of trust and credibility, on the basis of which it is possible to draw conclusions about the quality of sites.
3. If the domain has already been used before you, and its subject largely overlaps with yours, take advantage of the situation to the maximum. Put redirects from the old pages of this domain to the relevant new pages of your site, which will be available at new addresses after the move. So you can get free quality backlinks and an additional share of referral traffic.

3. Create a temporary page to display during the move.

If you purchased a domain “with history” for the move and some links already lead to it, we recommend putting a temporary “stub” on it - a page asking you to return later or with links to other information channels of your company. It should be shown to absolutely all users who get to one of the pages of the new domain before the end of the technical works. You can even add a countdown timer, if you have already set the exact date of release of the site on the new domain. It is extremely important that this page gives the response code 503 Service Unavailable.


Stub example on github

4. Uploading the full list of pages and setting up redirects

Before you move the site to another domain and create new versions of all the old pages on it, you should find out how many pages you have in principle and which ones. This will be needed to build a map redirects and their subsequent configuration. To do this, you will need a crawler that can compile a list of all the visible pages on the site, as well as any backlink monitoring service of your choice.

4.1. Collecting a list of site pages using a crawler

To collect and upload the list of visible pages of the site, you can use any desktop crawler that is convenient for you (in this article I will describe the procedures using the example of Netpeak Spider). Just run the crawling around the entire site with all the subdomains and directories taken into account, having previously disabled taking into account the indexing instructions in the settings, as well as selecting the minimum set of analyzed parameters.



In addition, such a check will allow identifying and eliminating all problems regarding the server response codes on the new domain - all broken links, redirects with a response code other than 301, and so on.

After the scan is complete, you only need to export the results to save the list of pages in a table form.

4.2. Collecting a list of pages using backlink monitoring services

We strongly recommend that you do not limit yourself to the list of pages obtained during crawling, and run through the list of backlinks. First, it will help to take into account the links that you might have missed. Secondly, you will have an excellent reason to check whether the broken backlinks, which seem to lead to your site, are not in the general list, but in the end give 404 an answer code. Traffic is lost on them, so it makes sense either to contact the owner of the site and replace the link, immediately indicating the new domain, or register a correct redirect for it.

This can be done with the help of “Link Analysis” in Serpstat , the “Explorer Website” tool in Ahrefs , as well as a number of other similar services. The choice will depend on your personal preferences.

4.3. Pre-cleaning list

After unloading the list of links to internal and external links of the site, follow a few simple steps that will prevent the appearance of a number of serious errors already on the new domain:

1. Make sure that the list of pages for relocation does not contain complete duplicate pages available at different addresses. You can find them by scanning the list pages with the page hash and text hash analysis enabled. If you find duplicates on the old domain that have external backlinks, it is recommended to set up a redirect from all duplicates to one new canonical page. It is better to take care of eliminating duplicates immediately at this stage, without waiting for the final check for errors.
2. Check all links to external sites that are available on your site: if possible, replace them with actual ones, or delete them altogether.
3. Find out if the site has links that lead to more inaccessible internal pages. If they are only available on your site, and nobody has put any backlinks on them, remove and replace them when transferring to a new domain. If these found invalid addresses appear in the list of backlinks, consider them when moving and set the redirect to the most relevant page.

4.4. Setting up server forwarding

The lists obtained by both methods should be combined into one table, eliminating duplicates, and registering the corresponding addresses for redirects to the new domain. For redirection, you should use 301 server redirect, which is configured using the .htaccess file. And the easiest way to do this is with identical old and new page names ( old.com/page-about-seo and new.com/page-about.seo ).

The code responsible for server-level redirection will look something like this:

RewriteCond%{HTTP_HOST} ^www\.old\.com$ [NC]RewriteRule ^(.*)$ http://new.com/$1 [R=301,L]RewriteCond%{HTTP_HOST} ^old\.com
RewriteRule ^(.*)$ http://new.com/$1 [R=301,L]

Also, do not forget when writing code for redirects in .htaccess to take into account the redirect to the main mirror of the site - with the prefix www. or without it, with the HTTP and HTTPS protocol.

5. Creating a site map

After creating all the necessary pages on the new domain, you will have the next step - creating a site map.

In total there are 6 types of maps, of which three are most often used - the basic XML Sitemap for all pages of the site, Image Sitemap for images and HTML Sitemap, whose main task is to simplify navigation inside the site for users. The first is created for absolutely all types of sites, the second - for sites with a large number of graphical content, which can also bring traffic from the search for pictures.

To create a map you can use several tools:

1. Built-in functionality of the CMS you use or additional external plugins for it.
2. Online site map generators (XML Sitemap Generator, XML-Sitemaps.com, Check Domains and others).
3. Special scripts for automatic generation of site maps.
4. Desktop tools (InSpyder) and crawlers with a built-in Sitemap file generator (Netpeak Spider, for example)
   

After creating and placing the map in the root directory of the site, do not forget to specify its address in the Sitemap directive of the robots.txt file.

6. Preparing a new robots.txt file

Before you release a new site and remove the “stub”, be sure to take care of correctly compiling a robots.txt file. One way to check the correctness of these indexing instructions is to use the “Virtual robots.txt” feature in Netpeak Spider.



With it, you can download the instructions you compiled for search robots into the program without modifying the real robots.txt file, and then look at the site "through the eyes of search engines." This will make it possible to understand whether some of the important pages were closed from being indexed, and vice versa.

After applying the new indexing instructions, be sure to conduct a final site check for indexability. If it turns out that you made a mistake somewhere, even if just because of carelessness, a significant part of your site may not get into the search engines index. The result will be the loss of a significant proportion of organic traffic.

7. Setting attribute rel = canonical

After you eliminate all duplicate and broken links, set up redirects and successfully transfer all content to the new domain, be sure to pay attention to the rel = canonical attribute. First, make sure that after the move, the page code contains no canonical attributes pointing to addresses from the old domain. Secondly, on pages that were not previously canonized, we recommend putting rel = canonical on them.

8. Notification of search engines about moving

After all the main technical work is left behind, you need to notify the search engines about the change of the site address.

8.1. Address change in Google Search Console

To change the address in GSC, you first need to register a new site, and then go to the settings of the old domain and select "Address change".



Select a new domain from the drop-down list and go through all the items in the Google Search Console checklist. After that you will confirm the sending of the request to change the address.

8.2. Changing the address in Yandex.Webmaster

In the panel for webmasters of the Yandex search engine, the moving procedure is performed in much the same way. You can easily specify a new address in the section “Indexing” → “Moving site”. It is desirable (but not necessary) that by this time the new domain has already been registered in your Webmasters account.

8.3. Google Analytics address change

To change the address in the Analytics settings, go to the settings section and select “Account Settings” → “Resource Settings”. In this section you will find the field “Default URL” in which you will need to specify a new address.



Please note that all previous settings related to e-commerce will need to be updated due to relocation.

8.4. Change of address in Yandex. Metric

To change the domain in your Yandex.Metrica account, go to the "Settings" section and on the "Summary" tab list the new site address.

9. Verification of tracking codes

Despite the relocation, your site, by and large, has not undergone any special changes. However, you still need to make sure that all the necessary tracking codes work correctly and are present on all pages of the site. We recommend doing this as follows:

1. Take a look at analytical reports that work in real time: with their help, it will be possible to understand whether the codes on your site work in principle.
2. Use parsing (data extraction) to search for codes on the site pages. You can use a crawler for this: you only need to set up parsing for snippets of tracking codes in order to understand which pages it is on and which pages it is missing.

10. Final error checking

After completing all the technical work related to the move, it is also important to conduct a final check and promptly correct any mistakes made. The sooner you find them, the easier it will be to eliminate them and avoid possible negative consequences.

10.1. Check pages from old domain

After successfully transferring content and setting up redirects from the old domain to the new one, be sure to run a scan on the list of old URLs. This is necessary for checking redirects, as well as searching for possible broken links and redirects with an incorrect response code (only 301 Moved Permanently is allowed ).

As part of the test, the crawler will show whether the site is:

• redirect chains,
• not 301 redirects,
• broken redirects.

10.2. Check pages on the new domain

You can do this test in the same way using a desktop crawler. It is desirable that there are no high and medium criticality errors on the site at all, but it is especially important to make sure that there are no following problems on it:

1. Incorrect server response codes.
   The site can be only 3 options response codes: 200 OK , 301 Moved Permanently and 200 OK & Canonicalized . Fourth, fifth and sixth is not given. All other codes, including all 4xx and 5xx, will indicate errors in the settings of the site and prevent it from being indexed by search engines. The only exceptions are pages with codes 200 OK & Disallowed and 200 OK & Noindex / Nofollow, which should be present on the site, but should not be indexed.
   
   
2. Duplicates
   If you have to carry out large-scale technical works during the moving process, we recommend not to postpone the correction of old technical errors and make everything “in one fell swoop.” These include all existing types of duplicates: duplicate pages, text content, H1, Title, and Description.
   
3. Missing metadata.
   Surely you had good reasons for transferring the site to a new domain, and, most likely, among them is the improvement of the site’s position in organic and the CTR increase. So that your efforts are not in vain, make sure that not only the updated URL, but also the correct Title with a well-written Description will appear in the snippet.
4. Errors in the site map.
   As they say, shit happens, and therefore errors can be found even in the site map. Their presence can adversely affect the indexing of the site by search engines, especially if you have a giant website with tens of thousands of pages. To verify the map, in the list of Netpeak Spider embedded tools, select XML Sitemap Validator and specify the address of the map to be verified.
   

Briefly about the main thing

Whatever the reason for transferring the site to a new domain, you should approach the technical side of the move very seriously. The procedure involves 10 basic steps, without which the move cannot be considered complete:

1. Create backup site.
2. Acquaintance with the history of the domain selected for the move.
3. Setting "stub" at the time of the move.
4. Collection of a complete list of pages for setting redirects.
5. Development and implementation of site maps.
6. Create a new robots.txt file.
7. Configure the Canonical attribute.
8. Change settings in the panels for webmasters and analytics systems.
9. Verification of tracking codes on the site.
10. Final check for errors.

To perform all the above steps, you will need a backlink collection service, a crawler, one of the tools available on the market for creating site maps, as well as Google Analytics, Google Search Console, Yandex.Metrica, and Yandex.Webmaster.