Dell Supported Configurations for Oracle Database 10g R2 for Windows ユーザーガイド

  • こんにちは!このDellストレージとネットワークガイドを読みました。Microsoft Windows Serverで動作するOracle Databaseのセットアップに関する質問にお答えできます。Fibre Channel、SAS、iSCSIストレージシステムの構成、ネットワーク設定、マルチパスソフトウェアのインストールなど、このドキュメントの内容についてご質問ください。
  • Fibre Channelクラスタのハードウェア接続方法を教えてください。
    PowerVault MD3000ストレージシステムの接続方法は?
    iSCSIクラスタの設定手順は?
    マルチパスの設定方法を教えてください。
    Oracleクラスタウェア、データベース、バックアップ用のディスクの準備方法を教えてください。
Dell PowerEdge Systems
Oracle Database on Microsoft
Windows Server x64
Storage and Network
Guide
Version 4.4
Notes, Cautions, and Warnings
NOTE: A NOTE indicates important information that helps you make better use of
your computer.
CAUTION: A CAUTION indicates potential damage to hardware or loss of data if
instructions are not followed.
WARNING: A WARNING indicates a potential for property damage, personal
____________________
Information in this publication is subject to change without notice.
© 2009–2010 Dell Inc. All rights reserved.
Reproduction of these materials in any manner whatsoever without the written permission of Dell Inc.
is strictly forbidden.
Trademarks used in this text: Dell™, the DELL logo, EqualLogic™, PowerEdge™, and PowerVault™
are trademarks of Dell Inc.; EMC
®
and PowerPath
®
are registered trademarks of EMC Corporation;
Intel
®
is a registered trademark of Intel Corporation in the U.S. and other countries; Microsoft
®
,
Windows
®
and Windows Server
®
are either trademarks or registered trademarks of Microsoft
Corporation in the US and/or other countries; Oracle
®
is a registered trademark of Oracle Corporation
in the US and/or other countries.
Other trademarks and trade names may be used in this publication to refer to either the entities claiming
the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and
trade names other than its own.
July 2010 Rev. A03
Contents 3
Contents
1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Required Documentation for Deploying the
Dell Oracle Database
. . . . . . . . . . . . . . . . . . . 7
Terminology Used in This Document
. . . . . . . . . . . 8
Getting Help
. . . . . . . . . . . . . . . . . . . . . . . . 9
Dell Support. . . . . . . . . . . . . . . . . . . . . . 9
Oracle Support . . . . . . . . . . . . . . . . . . . . 9
2 Fibre Channel Cluster Setup . . . . . . . . . . 11
Cabling Your Dell/EMC Fibre Channel Storage . . . . . 13
3 SAS Cluster Setup for the
Dell PowerVault MD3000 . . . . . . . . . . . . 15
Cabling Your SAS Storage System. . . . . . . . . . . . 17
4 iSCSI Cluster Setup for the Dell
PowerVault MD3000i and PowerVault
MD1000 Expansion Enclosures . . . . . . . . 19
Setting Up iSCSI Cluster With Dell PowerVault
MD3000i Storage System and Dell PowerVault
MD1000 Expansion Enclosures
. . . . . . . . . . . . . 21
Cabling Your iSCSI Storage System . . . . . . . . 21
4 Contents
5 iSCSI Cluster Setup for the
Dell EqualLogic PS Series
Storage Systems . . . . . . . . . . . . . . . . . . . 25
Cabling Dell EqualLogic iSCSI Storage System . . . . . 25
6 Configuring Network and Storage
for Oracle RAC Database . . . . . . . . . . . . 29
Configuring the Public and Private Networks. . . . . . 29
Configuring and Teaming the Private Network . . . 30
Configuring NIC Teaming for Your Private
Network Adapters . . . . . . . . . . . . . . . . . 31
Configuring the IP Addresses for Your
Public and Private Network Adapters . . . . . . . 33
Installing the Host-Based Software
Required for Storage
. . . . . . . . . . . . . . . . . . . 36
Installing Multi-Path Software for Storage
. . . . . . . 36
Installing EMC PowerPath for
Dell/EMC Systems. . . . . . . . . . . . . . . . . . 36
Installing Multi-Path Driver Software for
PowerVault MD3000 or PowerVault MD3000i . . . 37
Installing Multi-Path Driver Software for
EqualLogic iSCSI Storage Array . . . . . . . . . . 37
Verifying Multi-Path Driver Functionality . . . . . . 37
Verifying and Upgrading the Firmware . . . . . . . . . 37
Configuring Your EqualLogic iSCSI Storage
. . . . . . . 38
Creating Volumes . . . . . . . . . . . . . . . . . . 38
Configuring iSCSI Networks . . . . . . . . . . . . 39
Configuring Host Access to Volumes . . . . . . . . 39
Configuring Microsoft iSCSI Initiator . . . . . . . . 40
Contents 5
Verifying the Storage Assignment to the Nodes . . . . 41
Preparing the Disks for Oracle Clusterware,
Database, and Backup
. . . . . . . . . . . . . . . . . . 42
Enabling the Automount Option for
the Shared Disks . . . . . . . . . . . . . . . . . . 43
Preparing the OCR and Voting Disks for
Clusterware on Windows Server 2003 . . . . . . . 43
Preparing the OCR and Votingdisk for
Clusterware on Windows Server 2008 . . . . . . . 45
Preparing the Database Disk and
Flash Recovery Area for Database
Storage With OCFS . . . . . . . . . . . . . . . . . 46
Preparing the Database Disk and
Flash Recovery Area for Database
Storage With ASM . . . . . . . . . . . . . . . . . 47
7 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
6 Contents
Overview 7
Overview
The Storage and Networking Guide for Oracle Database on
Microsoft Windows applies to:
Oracle Database 10g R2 Enterprise Edition on Microsoft Windows Server
2003 R2 Standard or Enterprise x64 Edition or Windows Server 2008 SP2
Enterprise or Standard x64 Edition.
Oracle Database 10g R2 Standard Edition on Windows Server 2003 R2
SP2 Standard x64 Edition or Windows Server 2008 SP2 Standard
x64
Edition.
Required Documentation for Deploying the
Dell
Oracle Database
The documents required for installing the Dell|Oracle database are:
Oracle Database on Microsoft Windows Server x64 Operating System and
Hardware Installation Guide
—Describes the required minimum hardware
and software versions, how to install and configure the operating system,
how to verify the hardware and software configurations, and how to obtain
open source files.
Oracle Database on Microsoft Windows Server x64 Storage and Network
Guide
—Describes how to install and configure the network and the
storage solutions.
Oracle Database on Microsoft Windows Server x64 Database Setup and
Installation Guide
—Describes how to install and configure the
Oracle
database.
Oracle Database on Microsoft Windows Server x64 Troubleshooting
Guide
—Describes how to troubleshoot and resolve errors encountered
during the installation procedures described in the previous
modules.
NOTE: All modules provide information on how to receive technical assistance
from Dell.
8 Overview
Terminology Used in This Document
This document uses the terms logical unit number (LUN) and virtual disk.
These terms are synonymous and can be used interchangeably. The term
LUN is commonly used in a Dell/EMC Fibre Channel storage system
environment and virtual disk is commonly used in a Dell PowerVault SAS
or iSCSI (Dell PowerVault MD3000 and Dell PowerVault MD3000i with
Dell PowerVault MD1000 expansion) storage environment.
Dell EqualLogic PS series storage arrays include storage virtualization
technology. To better understand how these arrays operate, it is helpful to be
familiar with some of the terminologies used to describe these arrays and
their functions:
Member
—A single PS series array.
Group
—A set of one or more members that can be centrally managed.
Host servers access the data through a single group IP address.
Pool
—A RAID that can consist of the disks from one or more members.
Volume
—A LUN or virtual disk that represents a subset of the capacity of
a pool.
Overview 9
Getting Help
This section provides information on contacting Dell or Oracle for
whitepapers, supported configurations, training, technical support,
and general information.
Dell Support
For detailed information about using your system, see the documentation
that came with your system components.
For whitepapers, Dell-supported configurations, and general information,
see
dell.com/oracle
.
For Dell technical support for your hardware and operating system
software and to download the latest updates for your system, see
support.dell.com
. Information about contacting Dell is provided in the
Dell PowerEdge Systems Oracle Database on Microsoft Windows Server x64
Operating System and Hardware Installation Guide
and
Dell PowerEdge
Systems Oracle Database on Microsoft Windows Server x64 Troubleshooting
Guide
of your system.
Dell Enterprise Training and Certification is now available;
see
dell.com/training
for more information. This training service may
not
be offered in all locations.
Oracle Support
For training information on your Oracle software and application
clusterware, and for information about contacting Oracle, see
oracle.com
or see your Oracle documentation.
Technical support, downloads, and other technical information is available
at
metalink.oracle.com
.
10 Overview
Fibre Channel Cluster Setup 11
Fibre Channel Cluster Setup
WARNING: Before you begin any of the procedures in this section, read the
safety information that shipped with your system. For additional best practices
information, see dell.com/regulatory_compliance.
After a Dell Managed Services representative completes the setup of your
Fibre Channel cluster, verify the hardware connections and the hardware and
software configurations as described in this section. Figure 2-1 and Figure 2-2
show an overview of the connections required for the cluster and Table 2-1
summarizes the cluster connections.
Figure 2-1. Hardware Connections for a SAN-Attached Fibre Channel Cluster
Client Systems
Gigabit Ethernet Switches (Private Network)
Dell PowerEdge Systems
(Oracle Database)
CAT 5e/6 (Public NIC)
CAT 5e/6 (Copper Gigabit NIC)
Fiber Optic Cables
Dell/EMC Fibre Channel
Storage Systems
Dell/EMC Fibre Channel
Switches (SAN)
LAN/W AN
Additional Fiber Optic Cables
12 Fibre Channel Cluster Setup
Table 2-1. Fibre Channel Hardware Interconnections
Cluster Component Connections
Dell PowerEdge
system node
One Category 5 enhanced (CAT 5e) or CAT 6 cable from the
public NIC to
the LAN
One CAT 5e or CAT 6 cable from the private Gigabit NIC to
the Gigabit Ethernet switch
One CAT 5e or CAT 6 cable from a redundant private
Gigabit
NIC to a redundant Gigabit Ethernet switch
One fiber optic cable from HBA 0 to Fibre Channel switch 0
One fiber optic cable from HBA 1 to Fibre Channel switch 1
Dell/EMC Fibre
Channel storage
system
Two CAT 5e or CAT 6 cables connected to the LAN
One to four fiber optic cable connections to each Fibre
Channel switch. For
example, for a four-port configuration:
–One
fiber optic cable
from SPA port 0 to Fibre Channel
switch 0
–One
fiber optic cable
from SPA port 1 to Fibre Channel
switch 1
–One
fiber optic cable
from SPB port 0 to Fibre Channel
switch 1
•One
fiber optic cable
from SPB port 1 to Fibre Channel switch 0
Dell/EMC Fibre
Channel switch
One to four fiber optic cable connections to the
Dell/EMC
Fibre Channel storage system
One fiber optic cable connection to each PowerEdge
system
HBA
Gigabit Ethernet
switch
One CAT 5e or CAT 6 connection to the private Gigabit NIC
on each PowerEdge system
One CAT 5e or CAT 6 connection to the remaining Gigabit
Ethernet switch
Fibre Channel Cluster Setup 13
Cabling Your Dell/EMC Fibre Channel Storage
You can configure your Oracle cluster storage system in a four-port storage
area network (SAN) attached configuration, depending on your needs.
See the following procedures for both configurations.
Figure 2-2 illustrates the hardware connections used in setting up a
SAN-attached Fibre Channel cluster.
Figure 2-2. Cabling in a Dell/EMC SAN-Attached Fibre Channer Cluster
Two HBA Ports for Node 1
Two HBA Ports for Node 2
sw1
Dell/EMC CX4-480 Fibre Channel Storage
sw0
SP-B
SP-A
14 Fibre Channel Cluster Setup
To configure your Oracle cluster storage system in a four-port, SAN-attached
configuration (see Figure 2-2):
1
Connect one optical cable from SP-A port 0 to Fibre Channel switch 0.
2
Connect one optical cable from SP-A port 1 to Fibre Channel switch 1.
3
Connect one optical cable from SP-B port 0 to Fibre Channel switch 1.
4
Connect one optical cable from SP-B port 1 to Fibre Channel switch 0.
5
Connect one optical cable from HBA 0 on node 1 to
Fibre
Channel switch 0.
6
Connect one optical cable from HBA 1 on node 1 to
Fibre
Channel switch 1.
7
Connect one optical cable from HBA 0 of each additional node to
Fibre
Channel switch 0.
8
Connect one optical cable from HBA 1 of each additional node to
Fibre
Channel switch 1.
SAS Cluster Setup for the Dell PowerVault MD3000 15
SAS Cluster Setup for the
Dell
PowerVault MD3000
WARNING: Before you begin any of the procedures in this section, read the
safety information that shipped with your system. For additional best practices
information, see dell.com/regulatory_compliance.
This section provides information and procedures to configure your
Dell PowerEdge systems and PowerVault MD3000 hardware and software
to function in an Oracle Real Application Cluster (RAC) environment.
Verify the hardware connections, and the hardware and software
configurations as described in this section using Figure 3-1, Table 3-1,
and Table 3-2.
Figure 3-1. Cabling the Serial-Attached SCSI (SAS) Cluster and
Dell
PowerVault MD3000
Public Network
LAN/WAN
PowerEdge Systems
PowerVault MD3000
Storage System
CAT 5e/6 (Copper Gigabit NIC)
CAT 5e/6 (Copper Gigabit NIC)
SAS Cables
16 SAS Cluster Setup for the Dell PowerVault MD3000
Table 3-1. SAS Cluster Hardware Interconnections
Cluster Component Connections
PowerEdge system node
One CAT 5e/6 cable from public NIC to the local
area network (LAN).
One CAT 5e/6 cable from private Gigabit NIC to
Gigabit Ethernet switch (private network).
One CAT 5e/6 cable from redundant private Gigabit
NIC to redundant Gigabit Ethernet switch
(private
network).
Two SAS connections to a PowerVault MD3000
storage system node using a SAS 5/E. See
“Cabling
Your SAS Storage System” on page 17.
PowerVault MD3000
Two CAT 5e/6 cables connected to a LAN (one from
each storage processor module).
Two SAS connections to each PowerEdge system
node using a SAS 5/E controller. See
“Cabling Your
SAS Storage System” on page 17.
Gigabit Ethernet switch
One CAT 5e/6 connection to the private Gigabit
NIC on each PowerEdge system.
One CAT 5e/6 connection to the other Gigabit
Ethernet switch.
SAS Cluster Setup for the Dell PowerVault MD3000 17
Cabling Your SAS Storage System
SAS clusters can only be installed in a direct-attached cluster and are limited
to two nodes only.
To configure your nodes in a direct-attached configuration (see Figure 3-2):
1
Connect one SAS cable from a port of the SAS controller of node 1 to the
In-0 port of RAID controller 0 in the PowerVault MD3000 RAID enclosure.
2
Connect one SAS cable from a port of the other SAS controller of node 1
to the In-0 port of RAID controller 1 in the PowerVault MD3000 RAID
enclosure.
3
Connect one SAS cable from a port of the SAS controller of node 2 to the
In-1 port of RAID controller 0 in the PowerVault MD3000 RAID enclosure.
4
Connect one SAS cable from a port of the other SAS controller of node 2
to the In-1 port of RAID controller 1 in the PowerVault MD3000 RAID
enclosure.
Figure 3-2. Cabling in a Direct-Attached SAS Cluster
Dual-HBA Host Server
Dual-HBA Host Server
RAID Controller Module 1
PowerVault MD3000 RAID
Enclosure
MD1000 Expansion Enclosure
MD1000 Expansion Enclosure
RAID Controller Module 0
18 SAS Cluster Setup for the Dell PowerVault MD3000
iSCSI Cluster Setup 19
iSCSI Cluster Setup for the
Dell
PowerVault MD3000i
and
PowerVault MD1000
Expansion
Enclosures
WARNING: Before you begin any of the procedures in this section, read the
safety information that shipped with your system. For additional best practices
information, see dell.com/regulatory_compliance.
This section provides information and procedures to configure your
Dell PowerEdge systems and Dell PowerVault MD3000i hardware
and software to function in an Oracle Real Application Cluster (RAC)
environment.
Verify the hardware connections, and the hardware and software
configurations, using the Supported Configuration figures contained in the
Dell PowerVault MD3000i Support Matrix available at support.dell.com.
Table 4-1. iSCSI Hardware Interconnections
Cluster Component Connections
One PowerEdge
system
node
One CAT 5e/6 cable from public NIC to the local area
network (LAN).
One CAT 5e/6 cable from private Gigabit NIC to Gigabit
Ethernet switch (private network).
One CAT 5e/6 cable from redundant private Gigabit NIC
to redundant Gigabit Ethernet switch (private network).
NOTE: For additional information on Dell PowerVault
MD3000i system see your Dell PowerVault MD3000i SetUp
documentation.
20 iSCSI Cluster Setup
One Dell PowerVault
MD3000i storage
system
Two CAT 5e/6 cables connected to LAN (one from each
storage processor module) for the management interface.
Two CAT 5e/6 cables per storage processor for iSCSI
interconnect.
NOTE: For additional information on Dell PowerVault
MD3000i system see your Dell PowerVault MD3000i Setup
documentation.
One Dell PowerVault
MD1000 storage
expansion enclosure
(optional)
Additional Serial-attached SCSI (SAS) cable connections
as required for the MD1000 expansion enclosures.
Table 4-1. iSCSI Hardware Interconnections
Cluster Component Connections
/