分享

【DKV】涨姿势:如何对运营中的数据中心进行Tier建造认证

 yi321yi 2019-11-14

July 2014/in Design

by Kevin Heslin

Telecom company Entel achieves first two Tier III Certification of Constructed Facility Awards in Chile

Empresa Nacional de Telecomunicaciones S.A. (Entel) is the largest telecommunications company in Chile. The company reported US$3.03 billion in annual revenue in December 2012, and an EBITDA around 40%. In Chile, Entel holds a leading position in traditional data services, growing through the integration of IT services, with significant experience.

Entel是智利最大的电信运营商。据报道,在2012该公司的全年收入达30.3亿美元,税息折旧及摊销前利润达40%左右。在智利,随着信息集成技术服务的不断发展,Entel在传统数据服务方面保持领先地位,拥有非常丰富的经验。

The company also offers mobile and wireline services (including data center and IT services, Internet, local telephony, long distance and related services) and call center operations in Peru. Its standardized service offering to all companies is based on cloud computing.

该公司提供移动通信及有线业务(包括数据中心和IT服务、互联网、市话、长话等相关服务),在秘鲁设置有呼叫中心。Entel为所有客户提供的标准化服务都基于其云计算。

To deliver these services, Entel has developed the largest mobile-fixed wire network in Chile, with 70 gigabyte per second (Gbps) of capacity. The company serves 9.3 million mobile customers and offers an MPLS-IP network of wide and national coverage with quality of service (QoS) with 8.8 Gbps peak traffic in 2011. The company also provides international network connectivity (internet peak traffic of 17.7 Gbps in 2011).

为了实现这些业务,Entel 建设了智利最大的移动通信及有线网络,带宽高达70Gbps(译者注:Gbps=giga bits per second≠gigabyte/s,应为原作者笔误,此处按Gbps译)。在2011年,公司为930万移动用户提供服务,面向全国提供峰值流量高达8.8Gbps(基于QOS)的MPLS-IP网络。该公司还提供互联网接入服务(2011年,互联网峰值流量高达17.7Gbps)。

Entel is also a large data center infrastructure provider, with more than 13,800 square meters ( m2) in seven interconnected data centers (see Figure 1):

· Ciudad de Los Valles

· Longovilo (three facilities)

· Amunátegui

· Ñuñoa

· Pedro de Valdivia

Entel还是一大型数据中心基础设施提供商。公司拥有超过13800㎡机房,分布在以下7个互联网数据中心(见图1)

· Ciudad de Los Valles

· Longovilo (包含三个数据中心)

· Amunátegui

· Ñuñoa

· Pedro de Valdivia

Figure 1. General Scope of Entel’s Operations

These facilities host more than 7,000 servers and 2,000 managed databases. Entel currently plans to add 4,000 msup>2 in two steps at its Ciudad de los Valles facilities. As part of its IT services, Entel also provides an operational continuity service to more than 80,000 PCs and POS and terminals countrywide. Its service platform and processes are modeled under the ITIL framework, and Entel has SAS-70/II and COPC certifications.

这些设施内托管了超过7000台服务器和2000多个托管数据库。目前Entel计划分两步在Ciudad de los Valles数据中心增加4000 ㎡机房。作为其IT服务的一部分,Entel 面向80000台计算机、POS机、分布在全国的终端提供不中断的业务服务。该服务平台和流程都是在ITIL框架下模块化的,Entel 获得了SAS-70/II和COPC认证。

Finally, Entel also provides processing services, virtualization, on-demand computing, SAP outsourcing and other services. Entel has seen rapid growth in demand for IaaS platforms, that it meets with robust and multiple platform offerings (iSeries, p Series, Sun Solaris and x86) and different tiers of storage. Finally, the company has a 38% market share of managed services to large financial service institutions.

Entel还提供处理服务、虚拟化、按需服务的云计算、SAP外包服务等服务。Entel 牢牢抓住基础设施平台快速增长的需求,通过可靠且多样化的产品(如I Series, p Series, Sun Solaris and x86)和不同等级的存储,快速发展。公司在金融服务机构的托管市场占有38%的份额。

Entel has defined its corporate strategy to enable it to continue to lead the traditional telco market as well as increase coverage and capacity by deploying a fiber optic access network (GPON). The company also wants to increase its market share in O/S, data center, and virtual and on-demand services and expand to other countries in the region, leveraging its experience in Chile.

Entel公司已经确立公司策略以使得其能继续在传统电信业务市场保持领先地位,如通过部署光纤网络(GPON)来实现覆盖和容量的增长。公司还希望能够扩大在O/S、数据中心、虚拟化、按需服务的云计算的市场份额,借助公司在智利的经验将业务扩展到周边的国家。

Entel chose to invest in its own data centers for three reasons, two of which related directly to competitive advantage:

Entel选择投资自营数据中心基于三个原因,其中有两个和竞争性优势直接相关:

· Investing in its own infrastructure would help Entel develop its commercial offering to corporate clients in Chile. Entel believed that having control over its basic infrastructure would enable it guarantee the operational continuity of customers.

· Entel also wanted to add white space when it felt more capacity was needed. It feels this flexibility helped it win additional large deals.

·The country does not have enough experienced personnel with the experience to manage/coordinate facilities like Entel’s. The company finds it a challenge to coordinate and supervise subcontractors responsible for various systems.

· 对其自有基础设施投资将有利于提升其商业服务能力,以更好地满足其国内客户的需求。Entel相信对于基础设施的控制权将有利于其实现其对客户业务连续性的承诺。

· Entel希望在其需要更大的容量时能获得空闲资源。该公司认为这种弹性将帮助该公司获得额外的大订单。

· 该国家缺乏在类似Entel这种基础设施管理、协调方面拥有足够经验的人。公司发现协调和管理供应商是一巨大的挑战。

As part of this process, Entel determined that it would work with the Uptime Institute to earn Tier Certification for Constructed Facility at its Ciudad de Los Valles Data Center. As a result, Entel learned several important lessons about its operations and also decided to obtain the Uptime Institute’s Tier Certification of Operational Sustainability.

作为这一过程的一部分,Entel决定与Uptime Institute合作,为其Ciudad de Los Valles数据中心的建造设施获得Tier认证。于是Entel学习了一些重要的关于运营的课程,然后决定获得Uptime Institute的业务连续性运营认证。

Project Master Plan

项目总体规划

The initial phase of the project included the construction of a 2,000 mof floor space for servers. A second phase was recently inaugurated that added another 2,000 mof floor space for additional equipment. The complete project is intended to reach a total growth of 8,000 m2 distributed in four buildings, each one with two floors of 1,000 m2, and with a total of 26,000 m2 of building space. (The general layout of the data centers is shown in Figure 2.)

项目的第一阶段包括为服务器建设2000㎡的空间。项目的第二阶段已于近期创建,内容是为追加的设备追加2000㎡的空间。整个项目计划实现4栋楼总共增加机房面积8000㎡,其中每栋楼2层,每层1000㎡。总建筑面积将在项目完成后达到26000㎡(数据中心的总平面设计图如图2所示)。

Figure 2. General layout of the Entel facilities

The data centers had to meet four key requirements:

数据中心需满足以下四个关键需求:

1. It had to house the most demanding technical and IT equipment: 1,500 kilograms (kg)/m2 in IT spaces and more than 3,000 kg/m2 in battery spaces, with special support for heavier equipment such as transformers, diesel generators, and chillers.

2. It had to achieve Uptime Institute Tier III requirements, meaning that the design includes two independent and separate power and cooling distribution paths, each able to support 100% of the capacity to allow Concurrent Maintainability so that all the critical elements can be replaced or maintained without impact in the service.

3. The building had to have sufficient capacities to meet high electrical and cooling demand.

4. Service areas such as UPS and meet-me rooms had to be outside of the server rooms.

1. 它能够安装常见的基础设施和IT设备:IT设备区的承重应大于15000N/㎡,电池区的承重应大于30000 N/m2,,支持特别重的设备,如变压器、柴油发电机和冷冻机组。

2. 它应该达到Uptime Institute Tier III 的要求,这意味着设计有两条来源独立的、物理隔离的电源和制冷路径,每条都能承担100%的负载容量以实现可维护性,以便所有关键的部件可以在不影响业务的情况下被替换或维护。

3. 该建筑物需要有充足的容量来满足对电力和制冷的高需求。

4. 提供基础设施服务的区域如UPS间和进线室应在服务器机房之外。

The structural design of the facility also had to address the threat of earthquake.

设施的结构设计还应能应对地震的威胁。

Entel decided to certify its data centers to meet its commercial commitmentsDue to contractual agreements, Entel had to certify the infrastructure design and its facilities with an internationally recognized institution. In addition Entel wanted to validate its design and construction for audit processes and as a way to differentiate itself from competitors.

Entel决定验证数据中心达到了其商业承诺。由于合同协定的原因,Entel必须使得该基础设施的设计和设施通过一个国际认可的机构的认证。此外由于审计流程的原因,Entel希望认证该数据中心的设计和建设,这也是一种使该数据在竞争者中脱颖而出的捷径。

The first step was to choose a standard to follow. In the end, Entel decided to certify Ciudad de Los Valles according to Tier Standards by the Uptime Institute because it is the most recognized body in the Chilean market and customers were already requesting it. As a result Entel’s facility was the first in Chile to earn Tier Certification of Constructed Facility.

第一步是选择一个标准作为参考。最后,Entel公司决定参考Uptime Institute 的Tier标准对Ciudad de Los Valles数据中心进行认证,因为这在智利市场上最被广泛认同,客户们也对此有需求。Entel的设施通过了实施认证,这在智利是第一例。

Preparation

项目准备

Ciudad de Los Valles Data Center is a multi-tenant data center that Entel uses to provide housing and hosting services, so its customers also had to be directly involved in project planning, and their authorization and approvals were important. At the time the Tier Certification of Design Documents began, the facility was in production, with important parts of its server rooms at 100% capacity. Modifications to the infrastructure had to be done without service disruptions or incident.

Ciudad de Los Valles数据中心是一个提供空间租赁和托管服务的数据中心,有多个租户。因此该公司的客户也需要直接参与到该项目计划中,他们的授权和赞成是重要的。数据中心正在生产运营中,其中服务器机房的重要部分达到了100%的管控容量,设计认证开始进行。对基础设施做一些调整是有必要的,以避免服务中断或事故。

Tier III Certification of Constructed Facility testing had to be done at 100% of the electrical and air conditioning approved design load so coordination was extremely challenging.

Tier III实施认证需要对于电力和空调系统按照设计容量的100%进行测试验证,因此这对于协调工作提出了巨大的挑战。

As part of the design review, the Uptime Institute consultants recommended some important improvements:

  • Separate common electrical feeds from the electrical generators.

  • Additional breakers to isolate bus bars serving critical loads.

  • Separate water tanks (chilled watertanks from building tanks).

  • Redundant electrical feeders for air handling units.

Additionally, it was essential that all the servers and communication equipment have redundant electrical feeders to avoid incidents during performance tests.

作为设计验证的一部分,Uptime Institute委员会提出了一些重要的建议:

  • 将市电进线线路和发电机分开;

  • 增加断路器,为给关键负载供电的母线提供隔离保护

  • 将生活用水等建筑储水箱和生产用水箱分离开来;

  • 为空气处理单元增加电力冗余。

此外,所有的服务器和通信设备必须有冗余的电力供应以避免在性能测试过程中发生事故。

Risks and Mitigation

风险及风险管理

Recognizing that Tier Certification testing would be challenging, Entel developed an approval process to help it meet what it considered four main challenges:

· Meeting the Tier Certification timeline with a range of stakeholders to inform and coordinate.

·  Preventing incidents due to activities necessary to test the infrastructure.

· Avoiding delays caused by coordination problems and obtaining approvals and permissions to modify the infrastructure.

· The possible existence of unidentified/undocumented single-corded servers and telecom equipment.

在意识到Tier验证非常具有挑战性后,Entel公司开发了一个批准流程来解决被认为的四大主要挑战:

· 通知和协调干系人,满足Tier认证的时间表;

· 预防因测试基础设施过程必要的活动而导致事故发生;

· 避免因协调问题、获得对基础设施调整的批准和许可等方面原因导致的拖延;

· 那些可能存在的未被识别或记载的单电源服务器和电信设备。

The approval process included a high-level committee, including commercial and technical executives to ensure communications. In addition every technical activity had to be approved in advance, including a detailed work plan, timing, responsibilities, checkpoints, mitigation measures and backtracking procedures. And for the most important activities, the plan was presented to the most important customers.

该批准流程包括一个高级别的委员会,包括商务和技术经理,以确保沟通顺利。此外每个技术事件必须被先验证,包括一个详细的工作计划、时序、责任、检查点、风险控制方法和倒回流程。对于最重要的事件,计划将被提交给重要客户。

The Certification process proved to be an excellent opportunity to improve procedures and test them. The process also made it possible to do on-the-job training and check the data center facilities at full load.

该认证流程被证明为改进和验证程序的一个绝佳的机会,该流程也使得在职培训和检验数据中心基础设施满负荷运行成为可能。

In addition, Entel completed the Tier Certification process of both design and facility without experiencing any incidents. However changes made to meet Uptime Institute Tier III requirements led Entel to exceed its project budget. In addition, unidentified/undocumented single-corded equipment delayed work and the eventual completion of the project. In order to proceed, Entel had to visually check each rack in the eight data halls rack to identify the single-corded loads. Once the loads had been identified, Entel installed static transfer switches (STS) to protect the affected racks, which required coordinating the disconnection of the affected equipment and its reconnection to the associated STS.

此外,Entel完成了Tier认证体系的设计和实施认证,期间未发生任何事故。但是为了达到Uptime Institute Tier III的要求而做出的改变使得Entel超出了项目预算。未识别/未载明的单电源设备推延了工作和项目完成。Entel目视检查了八个数据中心包间的每个机架来发现单电源负载。一旦单电源设备被发现,Entel安装静态转换开关来防止测试影响机架,在此过程中需要协调断开设备和连接设备至STS。

Lessons Learned

学习到的知识

Entel learned a number of important lessons as a result of Tier Certification of two data centers.

在这两个数据中心认证的过程中Entel学习到了很多重要知识。

The most important conclusion is that is absolutely possible to Tier Certify an ‘in-service data center’ with good planning and validation, approval and execution procedures. At the Ciudad de Los Valles 1 Data Center, Entel learned the importance of having a good understanding of the Tier Certification process scope, timing and testing, and the necessity of having good server room equipment inventories.

最重要的结论是:在良好的计划、确认、批准和执行流程下,在运行中的数据中心实施Tier认证是完全可能的。在Ciudad de Los Valles Data Center 1号数据中心,Entel学习到对Tier认证流程、时序和测试的充分理解是非常重要的,建立服务器机房设备的详细清单是非常有必要的。

As a result of Tier Certification of Ciudad de Los Valles 2 Data Center, Entel can attest that is easier to certify a new data center with construction, commissioning and certification all taking place in order before the facility goes live.

在Ciudad de Los Valles 2号数据中心通过Tier认证后,对一个新数据中心,Entel有信心在其投入使用之前有条不紊地进行实施和试运转的认证。

Next Steps

下一个计划

Entel’s next goal is to obtain the Uptime Institute’s Operational Sustainability Certification. For a service provider like Entel, robust infrastructure is not enough:

· A good operation regime is as important as the design, construction and testing.

· It’s critical to have detailed maintenance plans and testing of the infrastructure equipment.

· Entel wants its own people to control operations.

· Entel needs well trained people.

Entel的下一个目标是获得Uptime Institute的运营认证。对于一个像Entel这样的服务提供商,仅拥有强大的基础设施硬件是不够的:

· 良好的操作管理方法和设计、建设和测试是一样重要的;

· 详细的基础设施运维和测试计划是非常重要的;

· Entel想用自有人员来做运维;

· Entel需要经过良好训练的人员。

Entel is preparing for this Certification by adapting its staffing plan, maintenance procedures, training and other programs to meet Uptime Institute requirements.

为了获得该认证,Entel 计划改变其用工计划、运维流程、培训和其他程序。

In addition to its other ‘firsts’ in terms of Tier III Certification of Constructed Facility—twice over—Entel seeks to be the first data center to achieve Tier III Gold Certification.

百尺竿头更进一步,在“第一个”通过Tier III实施认证的基础上,Entel非常希望成为(智利)第一个获得金牌运营认证的数据中心。

Mr. Juan Miquel Durán, electrical engineer, joined Entel Chile in September 2011. He has more than 20 years of experience, with strong knowledge of data centers, switching and telecommunication services.

He is responsible for Facilities operation and maintenance for Ciudad de los Valles TIER III Certified Data Centers. Mr. Duran is also responsible Entel’s Longovilo Data Centers.

He participated in the certification process team, and he has strong experience in data center operations (Negotiation and implementation of long terms housing contracts, according international standards), as well as in infrastructure mission critical data center projects planning and design, including tender formulation, designing, projects evaluation, management for different companies.

翻译:

侯立中

DKV(DeepKnowledge Volunteer)计划精英成员

中国移动浙江公司省公司网络部 基础设施现场管理(石桥枢纽

编辑:

李擎

北京欣盛云路科技有限公司 高级运营经理

公众号声明:

    本站是提供个人知识管理的网络存储空间,所有内容均由用户发布,不代表本站观点。请注意甄别内容中的联系方式、诱导购买等信息,谨防诈骗。如发现有害或侵权内容,请点击一键举报。
    转藏 分享 献花(0

    0条评论

    发表

    请遵守用户 评论公约

    类似文章 更多