Nothing Special   »   [go: up one dir, main page]

CN111565116A - Whole cabinet server management system and configuration method - Google Patents

Whole cabinet server management system and configuration method Download PDF

Info

Publication number
CN111565116A
CN111565116A CN202010229913.6A CN202010229913A CN111565116A CN 111565116 A CN111565116 A CN 111565116A CN 202010229913 A CN202010229913 A CN 202010229913A CN 111565116 A CN111565116 A CN 111565116A
Authority
CN
China
Prior art keywords
rmc
bmc
server
network
port
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010229913.6A
Other languages
Chinese (zh)
Inventor
韩红瑞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN202010229913.6A priority Critical patent/CN111565116A/en
Publication of CN111565116A publication Critical patent/CN111565116A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0893Assignment of logical groups to network elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/42Bus transfer protocol, e.g. handshake; Synchronisation
    • G06F13/4282Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • H04L41/0813Configuration setting characterised by the conditions triggering a change of settings
    • H04L41/082Configuration setting characterised by the conditions triggering a change of settings the condition being updates or upgrades of network functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/12Discovery or management of network topologies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/50Address allocation
    • H04L61/5007Internet protocol [IP] addresses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2101/00Indexing scheme associated with group H04L61/00
    • H04L2101/60Types of network addresses
    • H04L2101/618Details of network addresses
    • H04L2101/622Layer-2 addresses, e.g. medium access control [MAC] addresses

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)

Abstract

The invention provides a whole cabinet server management system and a configuration method, wherein the system comprises: the server computing node is connected with the data network through a first port and is connected with the management network through a second port; RMC network port connects the administrative network; the server BMC is connected to the RMC via an I2C bus, and the server BMC is also connected to the RMC via a USB bus. The invention realizes the scheme of adding a network MAC to the BMC and solves the network topology structure between the RMC and the node BMC. The two current network topological structures are fused, and the design scheme can meet the networking requirements of different customers.

Description

Whole cabinet server management system and configuration method
Technical Field
The invention relates to the technical field of servers, in particular to a whole cabinet server management system and a configuration method.
Background
At present, a whole cabinet or a multi-node server has a chassis/cabinet management unit RMC for performing power, fan, IO management, and the like of the whole machine, and the rest are each computing node. One BMC on each compute node is responsible for out-of-band management work for that node.
Currently, only 2 physical MAC addresses are provided on the RMC and node BMC chip, one for the BMC-specific management network interface (out-of-band management network interface) and the other for the data network interface (system OS network interface). The special network interface of BMC is exclusive interface of BMC out-of-band management, and can only be used for BMC out-of-band management; the system data network interface is a network data interface of the server OS for the system OS to perform network communication, and the general data network interface supports the NCSI function, so that the data interface can simultaneously support OS data communication and BMC out-of-band management.
The current common designs include two types, one is that two network ports are provided on a computing node, only one data network port is provided on a computing node in the other, and a management network is internally networked. The topological distribution is shown in fig. 1 and fig. 2.
The number of MAC addresses is limited, the two current topological structures have respective advantages and disadvantages, in practical application, some customers require scheme A, some customers require scheme B, and some customers require both schemes to be reserved, so that different product designs are required. Causing great troubles to the design, management and generation of the server.
Disclosure of Invention
In view of the above-mentioned deficiencies of the prior art, the present invention provides a whole rack server management system and a configuration method thereof, so as to solve the above-mentioned technical problems.
The invention provides a whole cabinet server management system, which comprises:
the server computing node is connected with the data network through a first port and is connected with the management network through a second port; RMC network port connects the administrative network; the server BMC is connected to the RMC via an I2C bus, and the server BMC is also connected to the RMC via a USB bus.
Further, the system further comprises:
the USB port of the RMC is connected with a USB concentrator main line; and the USB port of the BMC is connected with the branch line of the USB hub.
Further, the system further comprises:
the MAC network port of the RMC is connected with a management network, and the management network is connected with a front panel of a server.
Further, the system further comprises:
the RMC is connected with a power supply, a heat dissipation module and an IO module through I2C.
The invention also provides a configuration method of the whole cabinet server management system, which comprises the following steps:
USB communication environment in RMC end system and BMC end system;
configuring RMC IP and BMC IP of a server;
and setting the mapping relation between the BMC port and the remote management server port in the RMC.
Further, the USB communication environment in the RMC end system and the BMC end system includes:
configuring an rndis _ host as a dynamic module in a linux system kernel of the RMC;
and installing a USB Gadget driver in a linux system of the BMC.
Further, the RMC IP and BMC IP of the configuration server include:
setting a fixed IP for the RMC of the server in the server intranet;
and setting a static IP for the BMC according to the slot position of the BMC.
Further, the method further comprises:
the RMC verifies the firmware update file;
and the RMC issues the verified firmware update file to the target BMC, issues a firmware update instruction to the target BMC, and controls the target BMC to execute firmware update.
Further, the method further comprises:
and the RMC dynamically adds and ages a corresponding port mapping table according to the network state of the node BMC.
The beneficial effect of the invention is that,
the invention provides a whole cabinet server management system and a configuration method, which utilize the residual USB port of BMC to carry out internal networking with RMC, utilize TCP/IP over USB technology to virtualize a network MAC address to realize the transmission of network data messages on USB, and fuse two topologies in the prior art to form a unified scheme to meet different customer requirements. The invention realizes the scheme of adding a network MAC to the BMC and solves the network topology structure between the RMC and the node BMC. The two current network topological structures are fused, and the design scheme can meet the networking requirements of different customers. The RMC can provide a mode of independently accessing each node BMC in a port mapping mode, and is compatible with special scene requirements of independent access of an original management system and a client and the like. Repeated design is not needed, product development time and cost are saved, and multi-level networking and network change requirements of customers are met.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a diagram of an existing rack server management system architecture.
Fig. 2 is a diagram of a conventional whole rack server management system.
Fig. 3 is an architecture diagram of a whole rack server management system according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art through specific situations.
The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
Example 1
Referring to fig. 3, the present embodiment provides a system for managing servers in a whole rack, including: the server computing node is connected with the data network through a first port and is connected with the management network through a second port; RMC network port connects the administrative network; the server BMC is connected to the RMC via an I2C bus, and the server BMC is also connected to the RMC via a USB bus.
The specific topological structure comprises:
two MAC addresses on the node BMC, one for dedicated management network connection (purple) and one for data network (green), and two ports are directly output from the computing node;
the RMC has a network MAC on it for the dedicated management network connection (purple) and outputs from the front panel.
I2C of the RMC is connected with a power supply, a heat dissipation module, an IO module and each computing node for low-speed signal communication;
the USB Host of the RMC is connected to the USB HUB for connecting various computing nodes.
The USB Device on the computing node BMC is connected to the USB HUB and forms a connection with the RMC.
Introduction of TCP/IP over USB function:
the TCP/IP over USB technology uses a USB bus to transmit TCP/IP data messages.
RNDIS (Remote Network Driver Interface Specification) is a short for Remote Network Driver Interface Specification, is a USB Ethernet card model defined by Microsoft, and spans a transmission layer, a Network layer and a data link layer, defines a communication Interface Specification between a Network card or a Network card Driver and an upper layer protocol Driver, shields different bottom layer physical hardware, and enables the upper layer protocol Driver to communicate with the bottom layer Network card of any model. The NDIS creates a complete development environment for the network driver, only the NDIS function needs to be called, and the problems of a kernel of an operating system and interfaces with other drivers do not need to be considered, so that the network driver can be separated from complex communication with the operating system, and the network driver is greatly convenient to write. In addition, the NDIS packaging characteristic is utilized, so that the design of one layer of drive can be concentrated, the design complexity is reduced, and meanwhile, the driver stack is easy to expand. The RNDIS is actually a TCP/IP over USB based on the USB, namely TCP/IP is run on the USB device, and the USB device looks like a network card.
Example 2
The embodiment provides a method for configuring a whole cabinet server management system, which comprises the following steps:
s1, USB communication environment in the RMC end system and the BMC end system.
And the linux kernel of the RMC end configures the rdis _ host as a dynamic module.
Location:
->Device Drivers
->Network device support(NETDEVICES[=y])
->USB Network Adapters
->Multi-purpose USB Networking Framework(USB_USBNET[=m])
->Host for RNDIS and ActiveSync devices
And the BMC end linux is provided with a USB Gadget driver g _ ether.
Location:
->Device Drivers
->USB support(USB_SUPPORT[=y])
->USB Gadget Support(USB_GADGET[=y])│
->USB Gadget Drivers(<choice>[=m])│
->Ethernet Gadget(with CDC Ethernet support)(USB_ETH[=n])
S2, configuring RMC IP and BMC IP of the server.
In the design, an intranet IP address adopts a fixed IP address, the RMC address is fixed to 192.168.1.1, the IP address of the node BMC is related to the slot position where the node BMC is located, the slot position 0 address is fixed to 192.168.1.100, the slot position 1 address is fixed to 192.168.1.101, and the like.
Hardware IO serial numbers are arranged in the slot positions of the server nodes, and after the server nodes are inserted, the node BMC can sense the current slot position addresses by reading the IO. And then, configuring the static IP address according to the slot number. After the network is connected, the fixed IP address 192.168.1.1/2 of the RMC is tried to be connected, the state information is reported, and the data is synchronized into the RMC.
ifconfig usb0 192.168.1.1up
ifconfig usb0 192.168.1.100up
S3, setting the mapping relation between the BMC port and the remote management server port in the RMC.
In the design, aiming at part of special application scenes and customer requirements, a port mapping function is added in the RMC, so that each node BMC address in an intranet can access a remote management server in a port mapping mode, and a user can also independently access the function of the node BMC.
For example, the outer network IP of RMC is 10.16.1.5, the Web port of node BMC0 is mapped to 8080, the Web port of node BMC1 is mapped to 8081, and so on.
In addition, when the firmware is updated, a client directly logs in the RMC to update the firmware of the node BMC, and after the RMC receives the firmware verification package and verifies OK, the RMC forwards the firmware to the node BMC with the matched model, and the BMC updates the firmware. Therefore, when the client uploads the firmware once, the RMC will finish upgrading all the matched nodes BMC in batch, and give a feedback result of which nodes are upgraded successfully.
And for each node BMC, IP is distributed according to the slot position, mapping work of fixed port numbers is correspondingly and sequentially carried out, and the RMC dynamically adds and ages a corresponding port mapping table according to the network state of the node BMC. The user only needs to know the management network IP of the RMC and the port number which is required to be accessed and is related to the RMC, and the user can directly access the node BMC. For example, the outer network IP of RMC is 10.16.1.5, the Web port of node BMC0 is mapped to 8080, the Web port of node BMC1 is mapped to 8081, and so on. Accessing the RMC: direct access 10.16.1.5, and direct access to BMC0 10.16.1.5: 8080.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (9)

1. The utility model provides a complete cabinet server management system which characterized in that includes:
the server computing node is connected with the data network through a first port and is connected with the management network through a second port; RMC network port connects the administrative network; the server BMC is connected to the RMC via an I2C bus, and the server BMC is also connected to the RMC via a USB bus.
2. The rack server management system as set forth in claim 1, wherein the system further comprises:
the USB port of the RMC is connected with a USB concentrator main line; and the USB port of the BMC is connected with the branch line of the USB hub.
3. The rack server management system as set forth in claim 1, wherein the system further comprises:
the MAC network port of the RMC is connected with a management network, and the management network is connected with a front panel of a server.
4. The rack server management system as set forth in claim 1, wherein the system further comprises:
the RMC is connected with a power supply, a heat dissipation module and an IO module through I2C.
5. A method for configuring a whole cabinet server management system is characterized by comprising the following steps:
USB communication environment in RMC end system and BMC end system;
configuring RMC IP and BMC IP of a server;
and setting the mapping relation between the BMC port and the remote management server port in the RMC.
6. The method according to claim 5, wherein the USB communication environment in the RMC end system and the BMC end system comprises:
configuring an rndis _ host as a dynamic module in a linux system kernel of the RMC;
and installing a USB Gadget driver in a linux system of the BMC.
7. The method of claim 5, wherein the RMC IP and BMC IP of the configuration server comprises:
setting a fixed IP for the RMC of the server in the server intranet;
and setting a static IP for the BMC according to the slot position of the BMC.
8. The method of claim 5, further comprising:
the RMC verifies the firmware update file;
and the RMC issues the verified firmware update file to the target BMC, issues a firmware update instruction to the target BMC, and controls the target BMC to execute firmware update.
9. The method of claim 5, further comprising:
and the RMC dynamically adds and ages a corresponding port mapping table according to the network state of the node BMC.
CN202010229913.6A 2020-03-27 2020-03-27 Whole cabinet server management system and configuration method Pending CN111565116A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010229913.6A CN111565116A (en) 2020-03-27 2020-03-27 Whole cabinet server management system and configuration method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010229913.6A CN111565116A (en) 2020-03-27 2020-03-27 Whole cabinet server management system and configuration method

Publications (1)

Publication Number Publication Date
CN111565116A true CN111565116A (en) 2020-08-21

Family

ID=72074196

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010229913.6A Pending CN111565116A (en) 2020-03-27 2020-03-27 Whole cabinet server management system and configuration method

Country Status (1)

Country Link
CN (1) CN111565116A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113778667A (en) * 2021-08-17 2021-12-10 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Server node information management system and method, and readable medium
CN113805950A (en) * 2021-08-30 2021-12-17 超越科技股份有限公司 Method for managing server by cluster management system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101821724A (en) * 2007-07-26 2010-09-01 惠普开发有限公司 Centralized server rack management using usb
CN103312525A (en) * 2012-03-06 2013-09-18 百度在线网络技术(北京)有限公司 Mixed deployment system for business network and management network of server, server and switch
CN104182375A (en) * 2013-05-27 2014-12-03 鸿富锦精密工业(深圳)有限公司 Rack server boot configuration system and method
CN104238480A (en) * 2013-06-21 2014-12-24 鸿富锦精密工业(深圳)有限公司 Cabinet server BMC startup and shutdown control system and method
CN105739656A (en) * 2014-12-08 2016-07-06 营邦企业股份有限公司 Cabinet with automatic reset function and automatic reset method thereof
CN107465544A (en) * 2017-08-04 2017-12-12 郑州云海信息技术有限公司 A kind of setting fru system and method
CN107659437A (en) * 2017-09-15 2018-02-02 郑州云海信息技术有限公司 A kind of whole machine cabinet computing resource Pooled resources automatic recognition system and method
CN109818862A (en) * 2017-11-22 2019-05-28 杨娜 The emerging system and its device of data network and management network

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101821724A (en) * 2007-07-26 2010-09-01 惠普开发有限公司 Centralized server rack management using usb
CN103312525A (en) * 2012-03-06 2013-09-18 百度在线网络技术(北京)有限公司 Mixed deployment system for business network and management network of server, server and switch
CN104182375A (en) * 2013-05-27 2014-12-03 鸿富锦精密工业(深圳)有限公司 Rack server boot configuration system and method
CN104238480A (en) * 2013-06-21 2014-12-24 鸿富锦精密工业(深圳)有限公司 Cabinet server BMC startup and shutdown control system and method
CN105739656A (en) * 2014-12-08 2016-07-06 营邦企业股份有限公司 Cabinet with automatic reset function and automatic reset method thereof
CN107465544A (en) * 2017-08-04 2017-12-12 郑州云海信息技术有限公司 A kind of setting fru system and method
CN107659437A (en) * 2017-09-15 2018-02-02 郑州云海信息技术有限公司 A kind of whole machine cabinet computing resource Pooled resources automatic recognition system and method
CN109818862A (en) * 2017-11-22 2019-05-28 杨娜 The emerging system and its device of data network and management network

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113778667A (en) * 2021-08-17 2021-12-10 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Server node information management system and method, and readable medium
CN113778667B (en) * 2021-08-17 2024-01-23 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Server node information management system and method, and readable medium
CN113805950A (en) * 2021-08-30 2021-12-17 超越科技股份有限公司 Method for managing server by cluster management system

Similar Documents

Publication Publication Date Title
US11336567B2 (en) Service aware virtual private network for optimized forwarding in cloud native environment
US8495208B2 (en) Migrating virtual machines among networked servers upon detection of degrading network link operation
CN100524272C (en) Managing transmissions between devices
CN103138942B (en) Server rack system
US20180213669A1 (en) Micro data center (mdc) in a box system and method thereof
CN107947961A (en) Kubernetes Network Management System and method based on SDN
CN113783765B (en) Method, system, equipment and medium for realizing intercommunication between cloud internal network and cloud external network
CN110554943B (en) Multi-node server CMC management system and method based on I3C
US20110078299A1 (en) Systems and Methods for Reconfiguring a Network Adapter in Sleep Mode
US20140185627A1 (en) Link aggregation emulation for virtual nics in a cluster server
JP2012213240A (en) High performance ethernet (r) networking utilizing existing fiber channel fabric hba technology
CN104615455B (en) A kind of the IPMC program remote upgrading methods and device of ATCA frameworks
CN113572634B (en) Method and system for realizing two-layer intercommunication between in-cloud network and out-cloud network
CN111800298B (en) Network node management method, device, equipment and readable medium
CN111565116A (en) Whole cabinet server management system and configuration method
US10992526B1 (en) Hyper-converged infrastructure networking configuration system
US11824793B2 (en) Unlocking computing resources for decomposable data centers
CN107276826A (en) A kind of capacitor network collocation method and device
US20200403938A1 (en) Port Configuration Method and Communications Device
US11687470B2 (en) Expander I/O module discovery and management system
CN111459751A (en) High-end server management system
US11601377B1 (en) Unlocking computing resources for decomposable data centers
CN112737860A (en) Method for bare metal server VXLAN access and computer readable medium
CN113938378A (en) Method, device and medium for verifying network device configuration in cloud network environment
US9542200B2 (en) Dynamic port naming in a chassis

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200821

RJ01 Rejection of invention patent application after publication