Dell EMC Solutions for the Media and Entertainment Industry
In the previous article, we showed at what qualitatively new level Dell EMC integrated software and hardware solutions are working with video. Now we propose to deal with the technical side of these solutions and we begin with an overview of the most massive tool - workstations.
Dell has a wide range of content creation devices, from mobile to rack-mount models. For example, the Dell Precision Tower 5000 series single-socket systems are ideal for design work on Autodesk Maya or 3DS. Such a device can contain up to 18 cores in a central processor with a high clock frequency of up to 4 GHz. Graphics can be either NVIDIA Quadro or AMD FirePro.
The Dell Precision 7000 Series offers dual-socket options. For example, the T7910 model has a powerful chassis capable of supporting up to four video cards with consumption up to 675 W, and works silently thanks to optional liquid cooling. Such systems are designed to solve super-complex and resource-intensive tasks, such as, for example, 3D-modeling of complex structures in real time or photo-realistic rendering.
The Dell Precision Rack 7910 workstation is built around a 7000 Series chassis and offers the same specifications in a rack-mount format. The model is focused on virtual systems that provide the sharing of resources among several clients. It also works with PCoIP Teradici based network systems that are used to centralize workstations.
Today, few manufacturers offer such devices. It is worth noting the following advantages of the rack-mounted workstation R7910 compared to desktop systems:
For less demanding tasks, a line of small form factor Dell Precision 3000 Series with graphics cards of the lower class - NVIDIA Quadro or AMD Radeon Pro has been developed. Model T3620 is a mini-tower, built with the support of powerful mid-level graphics. This compact version is suitable for less demanding applications and can be used, for example, as a desktop publishing system. The Tower 3620 model will be ideal option when the space for the equipment costs much, and it is necessary to save the place as much as possible.
New model in the desktop lineup - Precision All-In-One. The device is equipped with a quad-core processor and AMD Radeon Pro WX5100 graphics. The 27-inch screen supports 4K UHD resolution and is 100% compliant with the Adobe RGB color gamut.
All of these workstations are adapted to work with Dell Canvas, a 27-inch horizontal touchscreen, as well as a high-precision pen and stylus panel and a large-format graphic tablet with 20-point touch recognition for graphic design and content creation.
The choice of Dell mobile workstations is just as extensive. The Precision 3000 and 5000 series are 15-inch models with NVIDIA Quadro mobile graphics and memory up to 32 GB. The Precision 7000 Series model with 15- or 17-inch screen, memory up to 64 GB and NVIDIA Quadro graphics (from P3000 to P5000) or AMD Radeon Pro will cope with resource-intensive content creation tasks.
The 17-inch 7000 Series is Dell EMC's first mobile workstation certified VR-Ready. All Precision platforms are certified to work with software independent software vendors (ISVs). Users can be confident in the stable work of professional software.
Dell Precision Optimizer automatically adjusts hardware for a specific application. This provides tangible performance gains and saves time for system setup. The manufacturer also provides workstations in customized configurations with all the software that the customer uses.
PowerEdge R730 is Dell EMC's main dual-processor 2U server with 2U support for up to 24 cores per processor. It provides a balance between CPU power and GPU, supports NVIDIA Tesla M10 and M60 or AMD Stream GPGPU accelerators. This allows you to deploy high performance VDI environments. Server configuration validated for use with VMWare and Citrix software.
R730 can be used in rendering farms, but the best option in this case would be PowerEdge FX2. This 2U chassis is equipped with various modular computing units. FC430 can be used eight modules or four modules FC630, while the second provides used for greater storage capacity. Since both are dual-socket, the version on the FC430 supports up to 16 processors with 24 cores on a 2U chassis, which is great for rendering. There are also data storage modules.
The M1000e is a 10U chassis with support for 16 blades M630 with two processors, which allows 32 processors to be used in one package. To centralize workstations via PCoIP, you can add Amulet Hotkey DXM630 with NVIDIA GPUs, up to the Quadro M5000SE.
Model R730XD is a specialized version of the R730 with an increased number of drives, but without GPU support. It can install 26 disks, so it is considered a server with enhanced local storage. C4130 is another specialized two-socket version of PowerEdge that supports up to four GPU accelerators (300 W) in a 1U-high chassis, making it an ideal platform for GPGPU applications.
As a result of purchasing EMC in September 2016, Dell EMC can provide a complete set of components to deploy a complete solution. Storage products include Isilon network storage for the media industry and Elastic Cloud Storage (ECS) cloud platform. The combination of these products gives Media Data Lake a solution that reduces costs by eliminating separate storage islands. Each file in the project, from recording to playback and transfer to the archive for long-term storage, is in the same file system.
In addition, Isilon’s built-in replication feature allows media companies to store content and provide access to it based on the value and demand for data. It provides optimal storage, performance and protection of critical data. The Isilon architecture can scale to dozens of petabytes, while the high performance of the Isilon storage cluster speeds up video editing, image rendering for high-resolution 3D animation, and color correction.
The Dell EMC ECS storage platform provides for archiving a local or geographically distributed archive that can integrate with cloud storage. ECS can also be used as a high-density repository, unlocking the potential of Isilon with CloudPools and other products. Finally, ECS is a cost-effective alternative to tape archives. To search and extract files from an archive on a magnetic tape, robotic libraries are required. In working with ECS files will be available instantly, without cost and complexity of maintenance.
Dell PremierColor monitors display realistic colors and are factory calibrated to meet industry standards for color right out of the box. The wide range of Adobe RGB, sRGB, Rec.709, DCI-P3 and Rec.2020 colors meets the requirements of professional users. The support of 1.07 billion colors makes it possible to better see the gradation of colors and ensures the accuracy of shades even in dark areas.
For guaranteed color accuracy, each monitor comes with a factory calibration report. Users can customize the colors as they like, and save the color settings in the Look UpTable (LUT) internal table. The Dell UltraSharp Calibration software will help them in this.
Dell UltraSharp monitors with Premiercolor technology vary in screen size and resolution. All devices range, starting with the smallest 25-inch QHD-display and ending with the largest 32-inch with a resolution of 8K, designed for different tasks of the emerging industry of media and entertainment. They provide consistent and accurate color and the initial preparation of the content, and during its final editing.
The communication of the three types of hardware listed above is provided by Dell EMC switches. The main S4000 series is 48-port devices in the 1U form factor with a capacity of 10 Gb / s ports and six ports at 40 Gb / s. These non-blocking devices operate at full media speed with extremely low latency. Additional features — such as airflow inversion — allow them to fit into any cooling topology.
There are versions with copper (S4048T) and optical (S4048) ports. Due to the different connection characteristics, the S4048 switch has a delay of 600 ns, and the S4048T provides a delay of 2.5 ms. The S4000 series is designed for virtualization environments and complies with IEEE standards. For S4048ON switch versions (with support for the Dell EMC Open Networking concept), the customer can choose from six options the network operating system that will satisfy his personal requirements. Dell EMC switches also have a significant price advantage over competitors.
Dell EMC has a dedicated team whose goal is to make sure that the equipment you choose meets the needs of the customer. In the media and entertainment industry, creating content goes through many stages and with the advent of new types of content (for example, VR), their number and diversity only increases. Despite the fact that they all have common features, the exact composition of the solution components depends on the direction of the company.
EMC has developed special tools to help you choose the right product. For example, the Dell EMC Online Workstation Advisor helps you find a workstation and tailor the hardware to your specific company needs. The Dell EMC Precision Optimizer solution, in turn, will provide the best configuration of selected hardware for specific tasks.
With large purchases, Dell Technologies Solution Center can help you figure out. Such centers are located almost all over the world, including North and South America, Europe, the Middle East, Southeast Asia, the Far East and Australia. The Dell Technologies Solution Center contains hardware for testing and analyzing: workstations, monitors, network equipment, servers, and data warehouses.
Solution architects work with the client throughout the entire selection process, starting with the definition of the company's main business goal and types of workloads. Dell EMC then shapes the solution and tests it in the context of a specific use case. Dell’s key advantage is that after the merger with EMC, a single manufacturer has all the necessary hardware for any test scenarios. The company guarantees that after installing the solution the client will not have any surprises.
Dell EMC employs engineers in all key areas. This allows them to use their expertise when creating a specific solution. For example, a client can make sure that switching to virtual or centralized workstations that are mounted in a rack will be as painless as possible and will solve business problems.
Customers can come with their own models and test them with different demo configurations, task sequences and benchmark tests to find out which option is best.
For example, loading large architectural models from a local array into virtual workstations on PowerEdge servers can be much faster than copying them over a network to a physical local workstation.
You can even test equipment samples from third-party suppliers. For example, the client will have the opportunity to test the work of VR with headsets and hardware optimized for client software platforms (Unreal Engine, etc.).
Of particular value is advice, which concerns the entire complex solution. The vast majority of systems are now supplied by Dell EMCs themselves, so solution architects at Dell Technologies support centers can be sure that their hardware exactly matches their goals and is best suited for the intended workflow, both in terms of performance and ease of use.
Next we look at a few configuration examples. They illustrate customized solutions that Dell EMC can create for the challenges of the media and entertainment industry.
To develop video content, you need a workstation with high storage requirements. For quick access, editors often copy videos to local storage, but practice shows that this is an inefficient way. If several people work with the same files, this can lead to conflicts even with a well-organized media asset management system.
It is also inefficient to store a large number of copies of large files: for example, videos with a resolution of 4K, taken at a speed of 60 frames per second. Television shows and virtual reality videos are also unprofitable to be kept separate. The best solution would be a fully integrated system with which different specialists work.
This is exactly what the Dell EMC offers. Dell Precision Workstations can be used to access video content — for example, in DPX or OpenEXR formats. The video is then transferred to a centralized repository — cluster-based storage, in which performance and capacity are balanced by using a combination of Isilon X and NL nodes.
The solution may also include an archiving layer using HD Series nodes. When post-edited using Dell Precision workstations and non-linear editing software (Avid, Adobe Premiere Pro, etc.) for which these stations are validated, the files are moved to the fast Isilon S-series storage systems. All this happens transparently to the user. There are no isolated storage pools, and there is one “data lake” accessible to all employees using standard protocols.
The OneFS Isilon operating system allows Linux workstations to use NFS, Windows SMB, or the HTTP and Hadoop Distributed File System (HDFS) options. Active Directory or LDAP can be used to control user access regardless of which system they are working with.
Thanks to SmartPool technology, all files are displayed in one place. In accordance with the policies set by the system administrator, with frequent use, the files will be moved to a higher level - to systems with higher performance, and for rare ones - to the archiving level. At the same time, even from the archiving level, they will always be available, and at the beginning of active use they will again be moved to the “fast” storage level.
All system components are integrated into an Ethernet network using Dell EMC S-Series switches with a transmission rate of 10 Gb / s. Isilon storage can be dynamically expanded as data is automatically replicated when nodes are added. For example, it takes about 60 seconds to go from 50 TB to a capacity of 75 TB. After upgrading, OneFS will look exactly the same to the user — it will just be a larger storage pool.
Thus, when scaling or upgrading the system, there is no need to transfer data to a new disk. In practice, the client may need to add capacity not to the upper level, which uses expensive S-series nodes, but to the lower one.
Although non-linear editing will depend on the characteristics of the repository and workstations, the work may also include sending jobs to the farm. It consists of PowerEdge servers configured for a specific task with an appropriate software agent, for example, for Adobe After Effects, Autodesk Backburner, Luster ShotReactor, or Wiretap.
It will also provide access to the required content through the same Isilon repository with OS OneFS. Copying the raw files to the render servers when sending jobs to the queue is not necessary. Dell EMC will help customers verify all of these aspects of the workflow prior to deployment to ensure that components work together.
The process of creating 3D content requires powerful workstations and server farm rendering, but the overall content pool and reliable network are still fundamental factors. Creating 3D content is a resource-intensive task, and the method of calculation depends on the specific stage of its implementation. At the stage of modeling and animation helps hardware 3D-acceleration and a higher clock frequency of each processor core, but not their number.
However, when it comes time to display the final results, the number of cores becomes important. For game content, rendering is performed dynamically using the player’s own equipment. The 3D designer may also need to locate a frame locally or more as a test.
For these two very different stages, the combination of specialized equipment will be the perfect configuration. Dell Precision workstations, validated and optimized for 3D modeling and animation, can be supplied as both centralized rack systems accessible via PCoIP and as virtual workstations on PowerEdge servers. In all cases, hardware 3D acceleration is required.
Depending on the specific needs, the Precision T5810, T7810 or T7910 workstations will be suitable platforms, and the R7910 is suitable for centralization or virtualization. For the rendering phase, the high-density racks of the PowerEdge blade servers are optimal. As a rule, the best option is to pack the maximum number of processors and cores into the smallest space with the lowest power consumption and cost per node.
This makes PowerEdge FX2 or M1000e high-density CPU servers the best choice. Meanwhile, GPU-based rendering is gaining popularity, for example, using IRAY from NVIDIA. For this scenario, the Dell EMC offers a PowerEdge C4130 solution. While storing 3D data requires significant storage capacity, it is helpful to have assets available centrally on a shared resource. Therefore, the Isilon OneFS file system with SmartPool levels will provide maximum opportunities for interaction and collaboration.
The render farm will also be able to access the shared storage, so rendering over the network does not mean transferring assets to another file system — the rendering task is simply sent to the queue.
Virtual reality does not quite match the traditional division between creating 3D content or CGI. VR production can be a combination of these options, but also has some special requirements. Creating content based on 360-format videos usually means combining files from many different cameras into one panoramic video. The shared file system Isilon OneFS and here shows its advantages.
Content can also be created from scratch using 3D animation software and the types of Precision workstations already described above. The difference is that the preview of the final results is usually carried out through the game engine - Unity or Unreal Engine.
The workstation for creating VR content must support these engines and the corresponding software. You need a very powerful 3D graphics with multiple video cards, as in Precision T7810 or T7910. Dell EMC Solution Centers can help you customize workstations with this and ensure they work properly with other components of the workflow.
Pixspan is part of the Autodesk Flame product family. Editing places a significant burden on all the hardware, but Pixspan software in combination with Dell EMC hardware eases this task.
Video processing is one of the most demanding tasks and generates heavy traffic on any network, even outside the multimedia and entertainment content industry. When it comes to uncompressed material or “lossless video” in high resolution, especially 4K and higher, the data stream reaches astronomical levels. Sometimes the load exceeds the capacity of even a 10-gigabit network.
Files must be copied to the workstation for processing, and then transferred back to the storage server or another workstation. Dell EMC Comprehensive Solution can make this process more efficient using Pixspan compression. Pixspan Bit Exact Compression Round Trip works with a wide range of standard video formats, including OpenEXR, DPX, Cineon, ARRIRaw and Canon C500 Raw. As a rule, it reduces the file size by 50-80% depending on the size of the original.
The files remain “native” to the video editing software, but in fact are converted to the Pixspan compressed format for transmission over the network. Compression is designed to speed up NIVIDIA GPUs, so it’s worth considering as an option Dell Precision workstations with Quadro M6000 or P6000 cards. The T7810 or T7910 can be considered the preferred option.
The video itself will be stored on Dell EMC Isilon storage systems with S-Series nodes, which are used for content processing, and then with X-Series, NL-Series, and HD Series nodes, as the content is archived. However, before the video becomes available for any kind of editing, it must go to the media asset management system.
At this stage, the lossless video is converted from the original format to the intermediate Pixspan format. For this, PowerEdge servers with NVIDIA GPUs are used to speed up compression. Pixspan not only halves the required bandwidth for delivering video over a network, but also reduces storage requirements. As a result, less than 50% of the capacity will be needed, which will be useful for the most expensive and fast nodes represented by the All Flash or S-Series systems.
Any file transfer will occur over the network served by the Dell EMC S4000 series switches, with low latency and high bandwidth. Thanks to this integrated solution, you can easily assess the quality of 4K video.
Pixspan technology is also included in the Autodesk Flame product family. There are certain options for reducing network load and storage capacity requirements, but such a system is more complicated than a simple file storage with workstations connected to the network.
Since all of the hardware components are produced by Dell EMC, in the Dell Technologies Solution Center you can deploy and fully test this configuration and then use it as a template for deployment. When the equipment is installed in the studio, it will work as expected. Administrators can also familiarize themselves with the system during the test and gain experience to support it in the future.
For decades, video production has been purely digital, but filmmaking has moved to a “digit” relatively recently. The advantage of this format in a continuous workflow is from receiving and creating content to broadcasting and distributing on demand. The growing popularity of services such as Netflix, Amazon Prime and BBC iPlayer is directly related to the processes of storing and delivering content.
Dell EMC integrated approach is relevant here. Workstations can be used for creative tasks and content creation, and Dell S4000 series switches are responsible for delivering it over the network. As in the nonlinear editing example above, the content is placed in the storage pool provided by Isilon. The PowerEdge Cluster is a tool for rendering graphics and creating effects.
Meanwhile, the Isilon repository comes to the fore in the delivery process. As in other examples, S-Series or All Flash nodes can be used for production, after which data is transferred to a cluster consisting of nodes of the X and NL series. It can be directly connected to another cluster of S-series nodes with ready-made content, which is then processed for broadcasting and delivered to the viewers - users of cable and satellite networks.
PowerEdge server clusters are used for encoding and multiplexing necessary for broadcasting. The content delivery network (CDN) for streaming can use the Isilon cluster directly, and as a result, the mechanisms for delivering content for broadcast and on-demand distribution now form a single entity with its production, which requires a new level of integration.
But there is also its complexity. Unlike broadcasting, where only one format is used, on-demand streaming uses many formats, resolutions and data rates that need to be encoded on the fly or in advance (for example, using a PowerEdge server cluster).
The BBC once admitted that it had to create more than 20 different versions of each television program available on iPlayer to cover all types of devices and connection speeds. In this regard, the storage capacity required for the preparation and delivery of television program files is constantly increasing.
For example, the Grand Amazon Amazon Prime series is shot at 4K resolution in HDR and requires 20–40 TB of data per episode. Services such as Netflix, Amazon Prime, BBC iPlayer and Hulu have their own characteristics: content can be available for a long time after most people want to use it.
High-capacity storage on the Isilon HD Series nodes can serve up to 68 PB in a single cluster. This is necessary to store a huge amount of video content on the Internet for a very long time, and such a requirement can easily be satisfied. Isilon also allows you to dynamically increase capacity as needed.
Dell provides advice throughout the system. It will become a reliable partner for companies that need solutions that will deliver content to viewers in all necessary formats.
The modular architecture of workstations and servers is based on standards. This means that any software should work on any hardware, although in fact it is not. The specific features inherent in specific hardware and driver combinations do not guarantee that the software will function optimally in any possible configuration.
Independent software vendors (ISVs) test their applications on specific hardware platforms and driver versions and certify only those combinations that have passed this test. As a result, independent software vendors will not provide the same level of support for hardware combinations and drivers that are not on the approved list. Perhaps they do not even want to provide any support in this case.
Therefore, media and entertainment companies are not recommended to use non-certified platforms for mission-critical software. Equipment purchases should be limited to what has been certified for specific software.
Fortunately, Dell EMC solutions are certified for one of the most important software platforms in entertainment environments - Autodesk Flame. The Flame v2017 extension 1 was approved by Autodesk for use on a Dell Precision T7910 workstation with a Xeon E5-2687W processor, NVIDIA Quadro M6000 graphics, 64 GB DDR4 ECC SDRAM, a pair of 256 GB SSD and CentOS Linux version 7.2 (1511).
The first company to take advantage of this decision immediately after the release was Chimney, a post-production studio from Sweden with branches around the world. “We held the Flame update until the Dell EMC platform received the certificate,” explains Chimney technical director Nicklas Aldergren. “This allowed us to get the latest technical specification, and also saved us at least 30% on equipment. The liquid cooling option enabled the installation of workstations in office space, rather than remotely in a data center with access via KVM. This saves on fiber optic lines for KVM and simplifies everything. ”
Chimney is a prime example of a company where certification is a key requirement for equipment partners. The company uses Adobe Creative Cloud, Autodesk Maya, Nuke for Foundry and Avid Media Composer, most of which have specific requirements.
Chimney has 50 workstations equipped with Avid Media Composer software on certified Dell Precision workstations. Information on how to achieve the most efficient operation of equipment with software can be obtained either from the ISV itself or from third-party users. For example, there are setup guides for working with certified hardware from Autodesk and Avid. Since the experts have already completed their work, there is no need to spend time re-testing and tuning.
Hardware certification is not mandatory for each software platform, and some ISVs prefer to certify only individual components — in the end, any vendor using them will meet these requirements. But for complex applications, there is no other choice: the entire platform is certified.
“Flame is high-tech software that requires specific hardware, and we want software and hardware manufacturers to support the solution,” explains Oldergren.
There are no universal solutions - there are different requirements and different tasks. Video editing focuses on storage, which is associated with a huge amount of video content. Now, when the resolution has risen to 4K and higher, the importance of storage has grown even stronger. Animation requires fully optimized, powerful workstations and a server farm rendering with high density of equipment. Virtual reality is sharpened on the efficiency of workstations, which should allow viewing VR-content as it is created.
Many important tasks will require professional-grade monitors that can reproduce high-quality colors, display an image with high detail and easily interface with Precision workstations. Dell UltraSharp monitors with PremierColor function are optimally suited for such purposes.
The layered approach that Dell EMC Isilon storage provides means that archived content will be accessible through the same universal file system as the data stored on high-performance nodes. It also means that the created content will continue to be available on “on demand” systems and will be able to be easily transferred to a CDN for streaming delivery and broadcast live.
It is fundamentally important that companies can create configurations suitable for specific workflows. Although the quantitative advantages of products in general depend on performance and price, in fact, these are not the only or even not the most important factors when buying equipment in the media and entertainment industry. Much more important is whether the vendor understands the business and specific tasks of the customer.
Dell EMC is ready to provide customers with the capabilities of their Centers and the experience of solution architects. Hardware combinations can be customized and tested in real-life production environments, with the same software and content samples that the client works with. Dell EMC offers hardware for all types of workflows in the media and entertainment industry, but companies can choose the most suitable solutions for themselves.
Dell Precision Workstations
Dell has a wide range of content creation devices, from mobile to rack-mount models. For example, the Dell Precision Tower 5000 series single-socket systems are ideal for design work on Autodesk Maya or 3DS. Such a device can contain up to 18 cores in a central processor with a high clock frequency of up to 4 GHz. Graphics can be either NVIDIA Quadro or AMD FirePro.
The Dell Precision 7000 Series offers dual-socket options. For example, the T7910 model has a powerful chassis capable of supporting up to four video cards with consumption up to 675 W, and works silently thanks to optional liquid cooling. Such systems are designed to solve super-complex and resource-intensive tasks, such as, for example, 3D-modeling of complex structures in real time or photo-realistic rendering.
The Dell Precision Rack 7910 workstation is built around a 7000 Series chassis and offers the same specifications in a rack-mount format. The model is focused on virtual systems that provide the sharing of resources among several clients. It also works with PCoIP Teradici based network systems that are used to centralize workstations.
Today, few manufacturers offer such devices. It is worth noting the following advantages of the rack-mounted workstation R7910 compared to desktop systems:
- Ergonomics and convenience: an employee has a low-noise and compact thin client on the table, which can be quickly replaced.
- Manageability and security: expensive computing resources are located in a server room that is guarded and monitored by sysadmins.
- Consolidation of computing resources : their density in the rack is higher than if you simply install workstations in the office. The server room also provides efficient cooling and power to the devices.
For less demanding tasks, a line of small form factor Dell Precision 3000 Series with graphics cards of the lower class - NVIDIA Quadro or AMD Radeon Pro has been developed. Model T3620 is a mini-tower, built with the support of powerful mid-level graphics. This compact version is suitable for less demanding applications and can be used, for example, as a desktop publishing system. The Tower 3620 model will be ideal option when the space for the equipment costs much, and it is necessary to save the place as much as possible.
New model in the desktop lineup - Precision All-In-One. The device is equipped with a quad-core processor and AMD Radeon Pro WX5100 graphics. The 27-inch screen supports 4K UHD resolution and is 100% compliant with the Adobe RGB color gamut.
All of these workstations are adapted to work with Dell Canvas, a 27-inch horizontal touchscreen, as well as a high-precision pen and stylus panel and a large-format graphic tablet with 20-point touch recognition for graphic design and content creation.
The choice of Dell mobile workstations is just as extensive. The Precision 3000 and 5000 series are 15-inch models with NVIDIA Quadro mobile graphics and memory up to 32 GB. The Precision 7000 Series model with 15- or 17-inch screen, memory up to 64 GB and NVIDIA Quadro graphics (from P3000 to P5000) or AMD Radeon Pro will cope with resource-intensive content creation tasks.
The 17-inch 7000 Series is Dell EMC's first mobile workstation certified VR-Ready. All Precision platforms are certified to work with software independent software vendors (ISVs). Users can be confident in the stable work of professional software.
Dell Precision Optimizer automatically adjusts hardware for a specific application. This provides tangible performance gains and saves time for system setup. The manufacturer also provides workstations in customized configurations with all the software that the customer uses.
Dell EMC PowerEdge Servers
PowerEdge R730 is Dell EMC's main dual-processor 2U server with 2U support for up to 24 cores per processor. It provides a balance between CPU power and GPU, supports NVIDIA Tesla M10 and M60 or AMD Stream GPGPU accelerators. This allows you to deploy high performance VDI environments. Server configuration validated for use with VMWare and Citrix software.
R730 can be used in rendering farms, but the best option in this case would be PowerEdge FX2. This 2U chassis is equipped with various modular computing units. FC430 can be used eight modules or four modules FC630, while the second provides used for greater storage capacity. Since both are dual-socket, the version on the FC430 supports up to 16 processors with 24 cores on a 2U chassis, which is great for rendering. There are also data storage modules.
The M1000e is a 10U chassis with support for 16 blades M630 with two processors, which allows 32 processors to be used in one package. To centralize workstations via PCoIP, you can add Amulet Hotkey DXM630 with NVIDIA GPUs, up to the Quadro M5000SE.
Model R730XD is a specialized version of the R730 with an increased number of drives, but without GPU support. It can install 26 disks, so it is considered a server with enhanced local storage. C4130 is another specialized two-socket version of PowerEdge that supports up to four GPU accelerators (300 W) in a 1U-high chassis, making it an ideal platform for GPGPU applications.
Dell EMC Storage Systems
As a result of purchasing EMC in September 2016, Dell EMC can provide a complete set of components to deploy a complete solution. Storage products include Isilon network storage for the media industry and Elastic Cloud Storage (ECS) cloud platform. The combination of these products gives Media Data Lake a solution that reduces costs by eliminating separate storage islands. Each file in the project, from recording to playback and transfer to the archive for long-term storage, is in the same file system.
In addition, Isilon’s built-in replication feature allows media companies to store content and provide access to it based on the value and demand for data. It provides optimal storage, performance and protection of critical data. The Isilon architecture can scale to dozens of petabytes, while the high performance of the Isilon storage cluster speeds up video editing, image rendering for high-resolution 3D animation, and color correction.
The Dell EMC ECS storage platform provides for archiving a local or geographically distributed archive that can integrate with cloud storage. ECS can also be used as a high-density repository, unlocking the potential of Isilon with CloudPools and other products. Finally, ECS is a cost-effective alternative to tape archives. To search and extract files from an archive on a magnetic tape, robotic libraries are required. In working with ECS files will be available instantly, without cost and complexity of maintenance.
Dell UltraSharp Monitors
Dell PremierColor monitors display realistic colors and are factory calibrated to meet industry standards for color right out of the box. The wide range of Adobe RGB, sRGB, Rec.709, DCI-P3 and Rec.2020 colors meets the requirements of professional users. The support of 1.07 billion colors makes it possible to better see the gradation of colors and ensures the accuracy of shades even in dark areas.
For guaranteed color accuracy, each monitor comes with a factory calibration report. Users can customize the colors as they like, and save the color settings in the Look UpTable (LUT) internal table. The Dell UltraSharp Calibration software will help them in this.
Dell UltraSharp monitors with Premiercolor technology vary in screen size and resolution. All devices range, starting with the smallest 25-inch QHD-display and ending with the largest 32-inch with a resolution of 8K, designed for different tasks of the emerging industry of media and entertainment. They provide consistent and accurate color and the initial preparation of the content, and during its final editing.
Dell EMC Networking
The communication of the three types of hardware listed above is provided by Dell EMC switches. The main S4000 series is 48-port devices in the 1U form factor with a capacity of 10 Gb / s ports and six ports at 40 Gb / s. These non-blocking devices operate at full media speed with extremely low latency. Additional features — such as airflow inversion — allow them to fit into any cooling topology.
There are versions with copper (S4048T) and optical (S4048) ports. Due to the different connection characteristics, the S4048 switch has a delay of 600 ns, and the S4048T provides a delay of 2.5 ms. The S4000 series is designed for virtualization environments and complies with IEEE standards. For S4048ON switch versions (with support for the Dell EMC Open Networking concept), the customer can choose from six options the network operating system that will satisfy his personal requirements. Dell EMC switches also have a significant price advantage over competitors.
It is important to make the right choice.
Dell EMC has a dedicated team whose goal is to make sure that the equipment you choose meets the needs of the customer. In the media and entertainment industry, creating content goes through many stages and with the advent of new types of content (for example, VR), their number and diversity only increases. Despite the fact that they all have common features, the exact composition of the solution components depends on the direction of the company.
EMC has developed special tools to help you choose the right product. For example, the Dell EMC Online Workstation Advisor helps you find a workstation and tailor the hardware to your specific company needs. The Dell EMC Precision Optimizer solution, in turn, will provide the best configuration of selected hardware for specific tasks.
With large purchases, Dell Technologies Solution Center can help you figure out. Such centers are located almost all over the world, including North and South America, Europe, the Middle East, Southeast Asia, the Far East and Australia. The Dell Technologies Solution Center contains hardware for testing and analyzing: workstations, monitors, network equipment, servers, and data warehouses.
Solution architects work with the client throughout the entire selection process, starting with the definition of the company's main business goal and types of workloads. Dell EMC then shapes the solution and tests it in the context of a specific use case. Dell’s key advantage is that after the merger with EMC, a single manufacturer has all the necessary hardware for any test scenarios. The company guarantees that after installing the solution the client will not have any surprises.
Dell EMC employs engineers in all key areas. This allows them to use their expertise when creating a specific solution. For example, a client can make sure that switching to virtual or centralized workstations that are mounted in a rack will be as painless as possible and will solve business problems.
Customers can come with their own models and test them with different demo configurations, task sequences and benchmark tests to find out which option is best.
For example, loading large architectural models from a local array into virtual workstations on PowerEdge servers can be much faster than copying them over a network to a physical local workstation.
You can even test equipment samples from third-party suppliers. For example, the client will have the opportunity to test the work of VR with headsets and hardware optimized for client software platforms (Unreal Engine, etc.).
Of particular value is advice, which concerns the entire complex solution. The vast majority of systems are now supplied by Dell EMCs themselves, so solution architects at Dell Technologies support centers can be sure that their hardware exactly matches their goals and is best suited for the intended workflow, both in terms of performance and ease of use.
Next we look at a few configuration examples. They illustrate customized solutions that Dell EMC can create for the challenges of the media and entertainment industry.
Content creation: data access and nonlinear editing
To develop video content, you need a workstation with high storage requirements. For quick access, editors often copy videos to local storage, but practice shows that this is an inefficient way. If several people work with the same files, this can lead to conflicts even with a well-organized media asset management system.
It is also inefficient to store a large number of copies of large files: for example, videos with a resolution of 4K, taken at a speed of 60 frames per second. Television shows and virtual reality videos are also unprofitable to be kept separate. The best solution would be a fully integrated system with which different specialists work.
This is exactly what the Dell EMC offers. Dell Precision Workstations can be used to access video content — for example, in DPX or OpenEXR formats. The video is then transferred to a centralized repository — cluster-based storage, in which performance and capacity are balanced by using a combination of Isilon X and NL nodes.
The solution may also include an archiving layer using HD Series nodes. When post-edited using Dell Precision workstations and non-linear editing software (Avid, Adobe Premiere Pro, etc.) for which these stations are validated, the files are moved to the fast Isilon S-series storage systems. All this happens transparently to the user. There are no isolated storage pools, and there is one “data lake” accessible to all employees using standard protocols.
The OneFS Isilon operating system allows Linux workstations to use NFS, Windows SMB, or the HTTP and Hadoop Distributed File System (HDFS) options. Active Directory or LDAP can be used to control user access regardless of which system they are working with.
Thanks to SmartPool technology, all files are displayed in one place. In accordance with the policies set by the system administrator, with frequent use, the files will be moved to a higher level - to systems with higher performance, and for rare ones - to the archiving level. At the same time, even from the archiving level, they will always be available, and at the beginning of active use they will again be moved to the “fast” storage level.
All system components are integrated into an Ethernet network using Dell EMC S-Series switches with a transmission rate of 10 Gb / s. Isilon storage can be dynamically expanded as data is automatically replicated when nodes are added. For example, it takes about 60 seconds to go from 50 TB to a capacity of 75 TB. After upgrading, OneFS will look exactly the same to the user — it will just be a larger storage pool.
Thus, when scaling or upgrading the system, there is no need to transfer data to a new disk. In practice, the client may need to add capacity not to the upper level, which uses expensive S-series nodes, but to the lower one.
Although non-linear editing will depend on the characteristics of the repository and workstations, the work may also include sending jobs to the farm. It consists of PowerEdge servers configured for a specific task with an appropriate software agent, for example, for Adobe After Effects, Autodesk Backburner, Luster ShotReactor, or Wiretap.
It will also provide access to the required content through the same Isilon repository with OS OneFS. Copying the raw files to the render servers when sending jobs to the queue is not necessary. Dell EMC will help customers verify all of these aspects of the workflow prior to deployment to ensure that components work together.
Animation 3D, VR and farm rendering
The process of creating 3D content requires powerful workstations and server farm rendering, but the overall content pool and reliable network are still fundamental factors. Creating 3D content is a resource-intensive task, and the method of calculation depends on the specific stage of its implementation. At the stage of modeling and animation helps hardware 3D-acceleration and a higher clock frequency of each processor core, but not their number.
However, when it comes time to display the final results, the number of cores becomes important. For game content, rendering is performed dynamically using the player’s own equipment. The 3D designer may also need to locate a frame locally or more as a test.
For these two very different stages, the combination of specialized equipment will be the perfect configuration. Dell Precision workstations, validated and optimized for 3D modeling and animation, can be supplied as both centralized rack systems accessible via PCoIP and as virtual workstations on PowerEdge servers. In all cases, hardware 3D acceleration is required.
Depending on the specific needs, the Precision T5810, T7810 or T7910 workstations will be suitable platforms, and the R7910 is suitable for centralization or virtualization. For the rendering phase, the high-density racks of the PowerEdge blade servers are optimal. As a rule, the best option is to pack the maximum number of processors and cores into the smallest space with the lowest power consumption and cost per node.
This makes PowerEdge FX2 or M1000e high-density CPU servers the best choice. Meanwhile, GPU-based rendering is gaining popularity, for example, using IRAY from NVIDIA. For this scenario, the Dell EMC offers a PowerEdge C4130 solution. While storing 3D data requires significant storage capacity, it is helpful to have assets available centrally on a shared resource. Therefore, the Isilon OneFS file system with SmartPool levels will provide maximum opportunities for interaction and collaboration.
The render farm will also be able to access the shared storage, so rendering over the network does not mean transferring assets to another file system — the rendering task is simply sent to the queue.
Virtual reality does not quite match the traditional division between creating 3D content or CGI. VR production can be a combination of these options, but also has some special requirements. Creating content based on 360-format videos usually means combining files from many different cameras into one panoramic video. The shared file system Isilon OneFS and here shows its advantages.
Content can also be created from scratch using 3D animation software and the types of Precision workstations already described above. The difference is that the preview of the final results is usually carried out through the game engine - Unity or Unreal Engine.
The workstation for creating VR content must support these engines and the corresponding software. You need a very powerful 3D graphics with multiple video cards, as in Precision T7810 or T7910. Dell EMC Solution Centers can help you customize workstations with this and ensure they work properly with other components of the workflow.
Content creation. Editing with Pixspan technology
Pixspan is part of the Autodesk Flame product family. Editing places a significant burden on all the hardware, but Pixspan software in combination with Dell EMC hardware eases this task.
Video processing is one of the most demanding tasks and generates heavy traffic on any network, even outside the multimedia and entertainment content industry. When it comes to uncompressed material or “lossless video” in high resolution, especially 4K and higher, the data stream reaches astronomical levels. Sometimes the load exceeds the capacity of even a 10-gigabit network.
Files must be copied to the workstation for processing, and then transferred back to the storage server or another workstation. Dell EMC Comprehensive Solution can make this process more efficient using Pixspan compression. Pixspan Bit Exact Compression Round Trip works with a wide range of standard video formats, including OpenEXR, DPX, Cineon, ARRIRaw and Canon C500 Raw. As a rule, it reduces the file size by 50-80% depending on the size of the original.
The files remain “native” to the video editing software, but in fact are converted to the Pixspan compressed format for transmission over the network. Compression is designed to speed up NIVIDIA GPUs, so it’s worth considering as an option Dell Precision workstations with Quadro M6000 or P6000 cards. The T7810 or T7910 can be considered the preferred option. The video itself will be stored on Dell EMC Isilon storage systems with S-Series nodes, which are used for content processing, and then with X-Series, NL-Series, and HD Series nodes, as the content is archived. However, before the video becomes available for any kind of editing, it must go to the media asset management system.
At this stage, the lossless video is converted from the original format to the intermediate Pixspan format. For this, PowerEdge servers with NVIDIA GPUs are used to speed up compression. Pixspan not only halves the required bandwidth for delivering video over a network, but also reduces storage requirements. As a result, less than 50% of the capacity will be needed, which will be useful for the most expensive and fast nodes represented by the All Flash or S-Series systems.
Any file transfer will occur over the network served by the Dell EMC S4000 series switches, with low latency and high bandwidth. Thanks to this integrated solution, you can easily assess the quality of 4K video.
Pixspan technology is also included in the Autodesk Flame product family. There are certain options for reducing network load and storage capacity requirements, but such a system is more complicated than a simple file storage with workstations connected to the network.
Since all of the hardware components are produced by Dell EMC, in the Dell Technologies Solution Center you can deploy and fully test this configuration and then use it as a template for deployment. When the equipment is installed in the studio, it will work as expected. Administrators can also familiarize themselves with the system during the test and gain experience to support it in the future.
Content delivery
For decades, video production has been purely digital, but filmmaking has moved to a “digit” relatively recently. The advantage of this format in a continuous workflow is from receiving and creating content to broadcasting and distributing on demand. The growing popularity of services such as Netflix, Amazon Prime and BBC iPlayer is directly related to the processes of storing and delivering content.
Dell EMC integrated approach is relevant here. Workstations can be used for creative tasks and content creation, and Dell S4000 series switches are responsible for delivering it over the network. As in the nonlinear editing example above, the content is placed in the storage pool provided by Isilon. The PowerEdge Cluster is a tool for rendering graphics and creating effects.
Meanwhile, the Isilon repository comes to the fore in the delivery process. As in other examples, S-Series or All Flash nodes can be used for production, after which data is transferred to a cluster consisting of nodes of the X and NL series. It can be directly connected to another cluster of S-series nodes with ready-made content, which is then processed for broadcasting and delivered to the viewers - users of cable and satellite networks.
PowerEdge server clusters are used for encoding and multiplexing necessary for broadcasting. The content delivery network (CDN) for streaming can use the Isilon cluster directly, and as a result, the mechanisms for delivering content for broadcast and on-demand distribution now form a single entity with its production, which requires a new level of integration.
But there is also its complexity. Unlike broadcasting, where only one format is used, on-demand streaming uses many formats, resolutions and data rates that need to be encoded on the fly or in advance (for example, using a PowerEdge server cluster).
The BBC once admitted that it had to create more than 20 different versions of each television program available on iPlayer to cover all types of devices and connection speeds. In this regard, the storage capacity required for the preparation and delivery of television program files is constantly increasing.
For example, the Grand Amazon Amazon Prime series is shot at 4K resolution in HDR and requires 20–40 TB of data per episode. Services such as Netflix, Amazon Prime, BBC iPlayer and Hulu have their own characteristics: content can be available for a long time after most people want to use it.
High-capacity storage on the Isilon HD Series nodes can serve up to 68 PB in a single cluster. This is necessary to store a huge amount of video content on the Internet for a very long time, and such a requirement can easily be satisfied. Isilon also allows you to dynamically increase capacity as needed.
Dell provides advice throughout the system. It will become a reliable partner for companies that need solutions that will deliver content to viewers in all necessary formats.
The importance of equipment certification
The modular architecture of workstations and servers is based on standards. This means that any software should work on any hardware, although in fact it is not. The specific features inherent in specific hardware and driver combinations do not guarantee that the software will function optimally in any possible configuration.
Independent software vendors (ISVs) test their applications on specific hardware platforms and driver versions and certify only those combinations that have passed this test. As a result, independent software vendors will not provide the same level of support for hardware combinations and drivers that are not on the approved list. Perhaps they do not even want to provide any support in this case.
Therefore, media and entertainment companies are not recommended to use non-certified platforms for mission-critical software. Equipment purchases should be limited to what has been certified for specific software.
Fortunately, Dell EMC solutions are certified for one of the most important software platforms in entertainment environments - Autodesk Flame. The Flame v2017 extension 1 was approved by Autodesk for use on a Dell Precision T7910 workstation with a Xeon E5-2687W processor, NVIDIA Quadro M6000 graphics, 64 GB DDR4 ECC SDRAM, a pair of 256 GB SSD and CentOS Linux version 7.2 (1511).
The first company to take advantage of this decision immediately after the release was Chimney, a post-production studio from Sweden with branches around the world. “We held the Flame update until the Dell EMC platform received the certificate,” explains Chimney technical director Nicklas Aldergren. “This allowed us to get the latest technical specification, and also saved us at least 30% on equipment. The liquid cooling option enabled the installation of workstations in office space, rather than remotely in a data center with access via KVM. This saves on fiber optic lines for KVM and simplifies everything. ”Chimney is a prime example of a company where certification is a key requirement for equipment partners. The company uses Adobe Creative Cloud, Autodesk Maya, Nuke for Foundry and Avid Media Composer, most of which have specific requirements.
Chimney has 50 workstations equipped with Avid Media Composer software on certified Dell Precision workstations. Information on how to achieve the most efficient operation of equipment with software can be obtained either from the ISV itself or from third-party users. For example, there are setup guides for working with certified hardware from Autodesk and Avid. Since the experts have already completed their work, there is no need to spend time re-testing and tuning.
Hardware certification is not mandatory for each software platform, and some ISVs prefer to certify only individual components — in the end, any vendor using them will meet these requirements. But for complex applications, there is no other choice: the entire platform is certified.
“Flame is high-tech software that requires specific hardware, and we want software and hardware manufacturers to support the solution,” explains Oldergren.
Correct balance
There are no universal solutions - there are different requirements and different tasks. Video editing focuses on storage, which is associated with a huge amount of video content. Now, when the resolution has risen to 4K and higher, the importance of storage has grown even stronger. Animation requires fully optimized, powerful workstations and a server farm rendering with high density of equipment. Virtual reality is sharpened on the efficiency of workstations, which should allow viewing VR-content as it is created.
Many important tasks will require professional-grade monitors that can reproduce high-quality colors, display an image with high detail and easily interface with Precision workstations. Dell UltraSharp monitors with PremierColor function are optimally suited for such purposes.
The layered approach that Dell EMC Isilon storage provides means that archived content will be accessible through the same universal file system as the data stored on high-performance nodes. It also means that the created content will continue to be available on “on demand” systems and will be able to be easily transferred to a CDN for streaming delivery and broadcast live.
It is fundamentally important that companies can create configurations suitable for specific workflows. Although the quantitative advantages of products in general depend on performance and price, in fact, these are not the only or even not the most important factors when buying equipment in the media and entertainment industry. Much more important is whether the vendor understands the business and specific tasks of the customer.
Dell EMC is ready to provide customers with the capabilities of their Centers and the experience of solution architects. Hardware combinations can be customized and tested in real-life production environments, with the same software and content samples that the client works with. Dell EMC offers hardware for all types of workflows in the media and entertainment industry, but companies can choose the most suitable solutions for themselves.