May 24, 2019 at 14:49How to automate IT infrastructure management - discuss three trends
Today we decided to talk about the tools that IT companies and IaaS providers use to automate their work with networks and engineering systems.
/ Flickr / Not4rthur / CC BY-SA
It is expected that with the launch of 5G networks, IoT devices will get a real mass distribution - according to some estimates, their number will exceed 50 billion by 2022.
Experts note that the existing infrastructure will not cope with the increased load. According to Cisco, in two years the traffic passing through the data center will reach 20.6 zettabytes.
For this reason, IT companies spend billions on the development of network infrastructure. For example, Google engaged in laying of new submarine cables in the Asia and Europe in order to reduce delays in data transmission in remote data center locations. IT giants are also building hyper-scalable data centers - AWS, Microsoft and Google have already spent on their creationmore than 100 billion dollars.
Obviously, in such (and simpler) systems it is impossible to monitor the correct operation of all switches, servers and cables manually. Software-defined networks (SDNs) and special protocols (such as OpenFlow ) come to the rescue .
Statista says that by 2021, the volume of traffic passing through SDN systems of data centers will more than double: from 3.1 zettabytes to 7.4 zettabytes. For example, Fujitsu implemented SDN technology in hundreds of its data centers located in different parts of the world. It uses software-defined networks and one of the local cloud providers in the USA.
IDC experts expect the SDN market to continue to grow. By 2021 histhe volume will reach $ 13 billion, given that in 2017 it was estimated at 6 billion.
The popularity of virtualization in recent years has been associated with the development of a large number of tools that automate VM management and increase their availability.
/ Pixabay / PD
Virtualization solution management systems are developing towards the use of machine learning technologies that automatically distribute the load between VMs. For example, the VMware NSX virtual environment solution has this functionality . It already helps IaaS providers distribute the load in multi-cloud and hybrid environments.
DCIM solutions (Data Center Infrastructure Management) are software that monitors the operation of data center engineering systems: the energy consumption of servers, storages, routers, power distributors, humidity levels, etc. Such systems are available in Dataspace and Xelent data centers, where 1cloud places its equipment.
In the first case, the DCIM system controls the electricity and water supply, air conditioning of the server and video surveillance throughout the building. In the second, it automatically stabilizes the output voltage in the mains, protecting servers and eliminating micro-breaks.
/ A large photo tour of the Moscow cloud 1cloud on Habr
. Artificial intelligence systems have also reached this area. Smart algorithms predict server failures by analyzing their “behavior”. For example, Litbit is working on Dac technology. The system monitors the state of iron using sensors installed in the engine room. They analyze ultrasonic frequencies and floor vibrations.
Based on these data, Dac detects anomalies and determines whether all equipment is operating correctly. If there is a problem, the system notifies the operators of the data center or independently disconnects the faulty servers.
So far, these technologies are not very widespread, but recently they have significantly strengthened their positions. According to analysts, in 2022, the DCIM market will amount to $ 8 billion, which will be twice as high as in 2017. Soon, these solutions will begin to appear in all major data centers.
/ Flickr / Not4rthur / CC BY-SA
Implement Software Defined Networks
It is expected that with the launch of 5G networks, IoT devices will get a real mass distribution - according to some estimates, their number will exceed 50 billion by 2022.
Experts note that the existing infrastructure will not cope with the increased load. According to Cisco, in two years the traffic passing through the data center will reach 20.6 zettabytes.
For this reason, IT companies spend billions on the development of network infrastructure. For example, Google engaged in laying of new submarine cables in the Asia and Europe in order to reduce delays in data transmission in remote data center locations. IT giants are also building hyper-scalable data centers - AWS, Microsoft and Google have already spent on their creationmore than 100 billion dollars.
Obviously, in such (and simpler) systems it is impossible to monitor the correct operation of all switches, servers and cables manually. Software-defined networks (SDNs) and special protocols (such as OpenFlow ) come to the rescue .
Statista says that by 2021, the volume of traffic passing through SDN systems of data centers will more than double: from 3.1 zettabytes to 7.4 zettabytes. For example, Fujitsu implemented SDN technology in hundreds of its data centers located in different parts of the world. It uses software-defined networks and one of the local cloud providers in the USA.
IDC experts expect the SDN market to continue to grow. By 2021 histhe volume will reach $ 13 billion, given that in 2017 it was estimated at 6 billion.
Go to virtual machines
The popularity of virtualization in recent years has been associated with the development of a large number of tools that automate VM management and increase their availability.
Automation tools are also provided by IaaS providers. For example, we in 1cloud offer a software interface that allows you to pick up a new virtual machine in a couple of minutes. It is also possible to manage the infrastructure using the API . For example, you can configure the shutdown of virtual machines according to a given schedule so as not to pay for their "idle" work. The API can also be used to change the number of cores and the amount of RAM.
/ Pixabay / PD
Virtualization solution management systems are developing towards the use of machine learning technologies that automatically distribute the load between VMs. For example, the VMware NSX virtual environment solution has this functionality . It already helps IaaS providers distribute the load in multi-cloud and hybrid environments.
Implement DCIM Systems
DCIM solutions (Data Center Infrastructure Management) are software that monitors the operation of data center engineering systems: the energy consumption of servers, storages, routers, power distributors, humidity levels, etc. Such systems are available in Dataspace and Xelent data centers, where 1cloud places its equipment.
In the first case, the DCIM system controls the electricity and water supply, air conditioning of the server and video surveillance throughout the building. In the second, it automatically stabilizes the output voltage in the mains, protecting servers and eliminating micro-breaks.
/ A large photo tour of the Moscow cloud 1cloud on Habr
. Artificial intelligence systems have also reached this area. Smart algorithms predict server failures by analyzing their “behavior”. For example, Litbit is working on Dac technology. The system monitors the state of iron using sensors installed in the engine room. They analyze ultrasonic frequencies and floor vibrations.
Based on these data, Dac detects anomalies and determines whether all equipment is operating correctly. If there is a problem, the system notifies the operators of the data center or independently disconnects the faulty servers.
So far, these technologies are not very widespread, but recently they have significantly strengthened their positions. According to analysts, in 2022, the DCIM market will amount to $ 8 billion, which will be twice as high as in 2017. Soon, these solutions will begin to appear in all major data centers.
Our additional resources and sources:JMAP - an open protocol will replace IMAP when exchanging emails.
How is the data center arranged and what is needed for its operation?
Myths about cloud technology - Part 1