User:Swapnil durgade/Oracle9i RAC on Fedora Core 1

Oracle 9i RAC On Fedora Core 1 

Author: Swapnil Durgade

Date: 05-Jan-2006

 

 Contents 

 

 1 What you need 

 2 Check Packages 

 3 Gcc 

<p class=MsoNormal><b> 4 Create empty files on node1 </b>

<p class=MsoNormal><b> 5 Bind rawdevices on both nodes </b>

<p class=MsoNormal><b> 6 create nbd service for node1 </b>

<p class=MsoNormal><b> 7 create nbd service for node2 </b>

<p class=MsoNormal><b> 8 Create test scripts on both nodes </b>

<p class=MsoNormal><b> 9 Oracle Preinstallation </b>

<p class=MsoNormal> 9.1 Shared Memory, oracle username and password, redhat-release, oracle home and Other Parameters on both nodes

<p class=MsoNormal> 9.2 DataFile

<p class=MsoNormal> 9.3 Oracle Environment

<p class=MsoNormal> 9.4 Setup RSH

<p class=MsoNormal> 9.5 Configure /etc/hosts

<p class=MsoNormal> 9.6 Test Network Settings

<p class=MsoNormal> 

<p class=MsoNormal><b> 10 Oracle Installation </b>

<p class=MsoNormal> 10.1 On Both Nodes Login as root in GUI and apply patch p3006854_9204_LINUX.zip

<p class=MsoNormal> 10.2 On Node1 Install Oracle Cluster Manager software

<p class=MsoNormal> 10.3 On Both Nodes, Install Version 10.1.0.2 of the Oracle Universal Installer

<p class=MsoNormal> 10.4 On Both Nodes, Run the 10.1.0.2 Oracle Universal Installer to patch the Oracle Cluster Manager (ORACM) to 9.2.0.5

<p class=MsoNormal> 10.5 On Node1 Modify the ORACM configuration files to utilize the hangcheck-timer

<p class=MsoNormal> 10.6 On Node2 Create log directory and Modify the ORACM configuration files to utilize the hangcheck-timer

<p class=MsoNormal> 10.7 On Both Nodes Modify Oracle Cluster Manager Startup Script

<p class=MsoNormal> 10.8 On Both Nodes Start the ORACM (Oracle Cluster Manager)

<p class=MsoNormal> 10.9 On Both Nodes Install 9.2.0.4 RAC Database

<p class=MsoNormal> 10.10 On Both Nodes Patch the RAC Installation to 9.2.0.5

<p class=MsoNormal> 10.11 On Both Nodes Create srvConfig.loc

<p class=MsoNormal> 10.12 On Both Nodes Start The GSD (Global Service Daemon)

<p class=MsoNormal> 10.13 On Both Nodes Create Listener Using command netca

<p class=MsoNormal> 10.14 On Both Nodes, make sure all raw devices are working

<p class=MsoNormal> 10.15 Only From Node1 Create a RAC Database using command dbca (Oracle Database Configuration Assistant)

<p class=MsoNormal> 10.16 Administering Real Application Clusters Instances

<p class=MsoNormal> 

<p class=MsoNormal><b> 11 Reference </b>

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal><b> 1. What you need </b>

<p class=MsoNormal>

<p class=MsoNormal> 1. Oracle9i Release 2 (9.2.0.4) [total 3 CDs] from http://www.oracle.com/technology/software/products/oracle9i/index.html

<p class=MsoNormal> 2. Patch p3006854_9204_LINUX.zip from metalink.oracle.com or from http://www.idevelopment.info/data/Oracle/DBA_tips/Linux/FedoraCore2_RPMS/p3006854_9204_LINUX.zip

<p class=MsoNormal> 3. 9.2.0.5 Patch Set from metalink.oracle.com

<p class=MsoNormal> 4. Fedora Core 1 Three CDs

<p class=MsoNormal> 5. nbd-server and nbd-client (Download from http://www.badongo.com/file.php?file=9iRAC__2006-01-05_9iRACSupportFiles.tar.gz

<p class=MsoNormal> 6. hangecheck-timer.o The attached hangecheck-timer.o will NOT work with SMPS kernels. (Download from http://www.badongo.com/file.php?file=9iRAC__2006-01-05_9iRACSupportFiles.tar.gz

<p class=MsoNormal> 7. 2 machines with around 60GB harddisk 512MB RAM for linux (Faster is better)

<p class=MsoNormal> 8. optionally 1 windows machine with putty will help a lot (http://www.google.co.in/search?hl=en&amp;q=download+putty&amp;meta=)

<p class=MsoNormal> You can remotely login to the linux boxes and copy paste commands on putty console.

<p class=MsoNormal>

<p class=MsoNormal><b> 2. On Both Nodes Check Packages </b>

<p class=MsoNormal>

<p class=MsoNormal> Install Fedora Core 1 all packages

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>rpm -q libpng gnome-libs compat-libstdc++ compat-libstdc++-devel compat-db compat-gcc compat-gcc-c++ openmotif21 pdksh sysstat

<p class=MsoNormal>

<p class=MsoNormal> If above mentioned packages are not found, install them

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>rpm -Uvh gnome-libs-1.4.1.2.90-40.i386.rpm compat-libstdc++-7.3-2.96.126.i386.rpm compat-libstdc++-devel-7.3-2.96.126.i386.rpm compat-db-4.1.25-2.1.i386.rpm compat-gcc-7.3-2.96.126.i386.rpm compat-gcc-c++-7.3-2.96.126.i386.rpm openmotif21-2.1.30-9.i386.rpm pdksh-5.2.14-24.i386.rpm sysstat-5.0.1-2.i386.rpm libpng10-1.0.13-13.i386.rpm tcl-devel-8.4.5-7.i386.rpm tcl-8.4.5-7.i386.rpm

<p class=MsoNormal>

<p class=MsoNormal><b> Remove iptables and kerberose rlogin </b>

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>rpm -e iptables redhat-config-securitylevel-tui iptables-devel iptables-ipv6 redhat-config-securitylevel  firstboot krb5-workstation

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir /software

<p class=MsoNormal>

<p class=MsoNormal> download 9iRACSupportFiles.tar.gz into /software from http://www.badongo.com/file.php?file=9iRAC__2006-01-05_9iRACSupportFiles.tar.gz

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /software

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>tar – zxvf 9iRACSupportFiles.tar.gz

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd 9iRACSupportFiles

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cp nbd* /bin

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cp hangcheck-timer.o /

<p class=MsoNormal>

<p class=MsoNormal><b> 3. On Both Nodes Gcc </b>

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mv /usr/bin/gcc /usr/bin/gcc323

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; color:navy;mso-ansi-language:DA'>mv /usr/bin/g++ /usr/bin/g++323 <span lang=DA style='mso-ansi-language:DA'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>ln -s /usr/bin/gcc296 /usr/bin/gcc

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>ln -s /usr/bin/g++296 /usr/bin/g++

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal><b> 4. On Node1 Create empty files </b>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir /nbd

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /nbd

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/system_raw bs=1M count=2048

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/users_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/temp_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/undo_1_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/undo_2_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/indx_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/tools_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/controlfile_1_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/controlfile_2_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/redo1_1_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/redo1_2_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/redo2_1_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/redo2_2_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/spfile_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/srvctl_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/nm_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/drsys_1_raw bs=1M count=1024

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/CMQuorumFile bs=1M count=2048

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dd if=/dev/zero of=/nbd/srvm bs=1M count=2048

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 *

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 /dev/nb*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 /dev/raw*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 /dev/raw/raw*

<p class=MsoNormal>

<p class=MsoNormal><b> 5. On Both Nodes Bind rawdevices </b>

<p class=MsoNormal>

<p class=MsoNormal> Add following lines to /etc/sysconfig/rawdevices

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw1 /dev/nb1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw2 /dev/nb2

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw3 /dev/nb3

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw4 /dev/nb4

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw5 /dev/nb5

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw6 /dev/nb6

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw7 /dev/nb7

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw8 /dev/nb8

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw9 /dev/nb9

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw10 /dev/nb10

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw11 /dev/nb11

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw12 /dev/nb12

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw13 /dev/nb13

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw14 /dev/nb14

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw15 /dev/nb15

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw16 /dev/nb16

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw17 /dev/nb17

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw18 /dev/nb18

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/dev/raw/raw19 /dev/nb19

<p class=MsoNormal>

<p class=MsoNormal> And make rawdevices to start on boot

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig rawdevices on

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>service rawdevices start

<p class=MsoNormal>

<p class=MsoNormal><b> 6. On Node1 create nbd service </b>

<p class=MsoNormal>

<p class=MsoNormal> create file /etc/init.d/nbd with following content

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#!/bin/bash

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'># chkconfig: 2345 98 15

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'># description: nbd client

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'># source function library

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>. /etc/init.d/functions

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>export PATH=/sbin:/usr/sbin:/usr/local/sbin:/root/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>{

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;Configuring kernel modules nbd, softdog, hangcheck-timer: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon modprobe nbd; modprobe softdog soft_margin=60 soft_noboot=1; rmmod hangcheck-timer; insmod /hangcheck-timer.o hangcheck_tick=30  hangcheck_margin=180;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;Setting Up Kernel Parameters: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon sysctl -p

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>sleep 1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#Check if nbd-server is already running

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>if [ `ps ax | grep nbd-server | wc -l` -gt 1 ]

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>then

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;nbd server is already running: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo_failure

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>else

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n $&quot;Starting nbd server: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon nbd-server 4101 /nbd/system_raw; nbd-server 4102 /nbd/users_raw; nbd-server 4102  /nbd/users_raw; nbd-server 4103 /nbd/temp_raw ; nbd-server 4104  /nbd/undo_1_raw ; nbd-server 4105 /nbd/undo_2_raw ; nbd-server 4106  /nbd/indx_raw ; nbd-server 4107 /nbd/tools_raw ; nbd-server 4108  /nbd/controlfile_1_raw ; nbd-server 4109 /nbd/controlfile_2_raw ; nbd-server 4110 /nbd/redo1_1_raw ; nbd-server 4111 /nbd/redo1_2_raw ; nbd-server 4112 /nbd/redo2_1_raw ; nbd-server 4113  /nbd/redo2_2_raw ; nbd-server 4114 /nbd/spfile_raw ; nbd-server 4115  /nbd/srvctl_raw ; nbd-server 4116 /nbd/nm_raw ; nbd-server 4117  /nbd/drsys_1_raw ; nbd-server 4118 /nbd/CMQuorumFile ; nbd-server 4119  /nbd/srvm

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>fi

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>sleep 5

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#Check if nbd-client is already running

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>if [ `ps ax | grep nbd-client | wc -l` -gt 1 ]

<p class=MsoNormal&gt;<span style='font-size:10.0pt;font-family:Verdana; color:green'>then

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;nbd client is already running: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo_failure

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>else

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n $&quot;Starting nbd client: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon nbd-client node1 4101 /dev/nb1; nbd-client node1 4102 /dev/nb2; nbd-client node1 4103 /dev/nb3; nbd-client node1 4104 /dev/nb4; nbd-client node1 4105 /dev/nb5; nbd-client node1 4106 /dev/nb6; nbd-client node1 4107 /dev/nb7; nbd-client node1 4108 /dev/nb8; nbd-client node1 4109 /dev/nb9; nbd-client node1 4110 /dev/nb10; nbd-client node1 4111 /dev/nb11; nbd-client node1 4112 /dev/nb12; nbd-client node1 4113 /dev/nb13; nbd-client node1 4114 /dev/nb14; nbd-client node1 4115 /dev/nb15; nbd-client node1 4116 /dev/nb16; nbd-client node1 4117 /dev/nb17; nbd-client node1 4118 /dev/nb18; nbd-client node1 4119 /dev/nb19

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>fi

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>}

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>{

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n $&quot;Shutting down nbd client: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>killproc nbd-client

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n $&quot;Shutting down nbd server: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>killproc nbd-server

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>}

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>status

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>{

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>if [ `ps ax | grep nbd-server | wc -l` -le 1 ]

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>then

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;nbd server is stopped &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>else

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;nbd server is running&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo_success

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;nbd-server process count: &quot; `ps ax | grep nbd-server | wc -l`

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>fi

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>if [ `ps ax | grep nbd-client | wc -l` -le 1 ]

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>then

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;nbd client is stopped &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>else

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;nbd client is running&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo_success

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;nbd-clients process count: &quot; `ps ax | grep nbd-client | wc -l`

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>fi

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>}

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>case &quot;$1&quot; in

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>status)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>status;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>restart)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>*)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo $&quot;Usage: $0 {start|stop|restart|status}&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>exit 1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>esac

<p class=MsoNormal>

<p class=MsoNormal> Add service to startup and start it

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 755 /etc/init.d/nbd

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig nbd --add

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig nbd on

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>service nbd start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#003366'>

<p class=MsoNormal><b> 7. On node2 create nbd service </b>

<p class=MsoNormal>

<p class=MsoNormal> create file /etc/init.d/nbd with following content

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#!/bin/bash

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'># chkconfig: 2345 98 15

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'># description: nbd client service used in Oracle Cluster Installation

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'># source function library

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>. /etc/init.d/functions

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>export PATH=/sbin:/usr/sbin:/usr/local/sbin:/root/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>{

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;Configuring kernel modules nbd, softdog, hangcheck-timer: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon modprobe nbd; modprobe softdog soft_margin=60 soft_noboot=1; rmmod hangcheck-timer; insmod /hangcheck-timer.o hangcheck_tick=30  hangcheck_margin=180;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;Setting Up Kernel Parameters: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon sysctl -p

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>sleep 1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#Check if nbd-client is already running

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>if [ `ps ax | grep nbd-client | wc -l` -gt 1 ]

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>then

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;nbd client is already running: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo_failure

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>else

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n $&quot;Starting nbd client: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>daemon nbd-client node1 4101 /dev/nb1; nbd-client node1 4102 /dev/nb2; nbd-client node1 4103 /dev/nb3; nbd-client node1 4104 /dev/nb4; nbd-client node1 4105 /dev/nb5; nbd-client node1 4106 /dev/nb6; nbd-client node1 4107 /dev/nb7; nbd-client node1 4108 /dev/nb8; nbd-client node1 4109 /dev/nb9; nbd-client node1 4110 /dev/nb10; nbd-client node1 4111 /dev/nb11; nbd-client node1 4112 /dev/nb12; nbd-client node1 4113 /dev/nb13; nbd-client node1 4114 /dev/nb14; nbd-client node1 4115 /dev/nb15; nbd-client node1 4116 /dev/nb16; nbd-client node1 4117 /dev/nb17; nbd-client node1 4118 /dev/nb18; nbd-client node1 4119 /dev/nb19

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>fi

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>}

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>{

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n $&quot;Shutting down nbd client: &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>killproc nbd-client

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>}

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>status

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>{

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'> if [ `ps ax | grep nbd-client | wc -l` -le 1 ]

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>then

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;nbd client is stopped &quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>else

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo -n &quot;nbd client is running&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo_success

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo &quot;nbd-clients process count: &quot; `ps ax | grep nbd-client | wc -l`

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>fi

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>}

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>#

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>case &quot;$1&quot; in

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>status)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>status;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>restart)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>stop

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>start

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>*)

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>echo $&quot;Usage: $0 {start|stop|restart|status}&quot;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>exit 1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>;;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>esac

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>

<p class=MsoNormal> Add service to startup and start it

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 755 /etc/init.d/nbd

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig nbd --add

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig nbd on

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>service nbd start

<p class=MsoNormal>

<p class=MsoNormal><b> 7. On Both Nodes Create test scripts </b>

<p class=MsoNormal>

<p class=MsoNormal> Create /bin/rawtest with following content

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>alias ls=ls --color=tty

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>cd /orac/

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>for F in `ls -w 1` ; do echo &quot;File $F&quot;; dd if=$F of=/dev/null count=10; done

<p class=MsoNormal>

<p class=MsoNormal> Create /bin/rlinks with following content

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw1 /orac/system_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw2 /orac/users_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw3 /orac/temp_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw4 /orac/undo_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw5 /orac/undo_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw6 /orac/indx_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw7 /orac/tools_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw8 /orac/controlfile_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw9 /orac/controlfile_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw10 /orac/redo1_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw11 /orac/redo1_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw12 /orac/redo2_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw13 /orac/redo2_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw14 /orac/spfile_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw15 /orac/srvctl_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw16 /orac/nm_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw17 /orac/drsys_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw18 /orac/CMQuorumFile

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ln -s /dev/raw/raw19 /orac/srvm

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>chown oracle:dba /orac/*

<p class=MsoNormal>

<p class=MsoNormal> Make scripts executable

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 755 /bin/rawtest

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 755 /bin/rlinks

<p class=MsoNormal>

<p class=MsoNormal><b> 9 Oracle Preinstallation </b>

<p class=MsoNormal>

<p class=MsoNormal><b> 9.1 On both nodes setup Shared Memory, oracle username and password, redhat-release, oracle home and Other Parameters </b>

<p class=MsoNormal>

<p class=MsoNormal> Login as root and run following commands

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;kernel.shmmax = 2147483648&quot; &gt;&gt; /etc/sysctl.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;kernel.shmmni = 128&quot; &gt;&gt; /etc/sysctl.conf <span style='color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;kernel.shmall = 2097152&quot; &gt;&gt; /etc/sysctl.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;kernel.sem = 250 32000 100 128&quot; &gt;&gt; /etc/sysctl.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;fs.file-max = 65536&quot; &gt;&gt; /etc/sysctl.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;net.ipv4.ip_local_port_range = 1024 65000&quot; &gt;&gt; /etc/sysctl.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>sysctl -p

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;oracle soft nofile 65536&quot; &gt;&gt; /etc/security/limits.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;oracle hard nofile 65536&quot; &gt;&gt; /etc/security/limits.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;oracle soft nproc 16384&quot; &gt;&gt; /etc/security/limits.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;oracle hard nproc 16384&quot; &gt;&gt; /etc/security/limits.conf

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>groupadd oinstall

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>groupadd dba

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>groupadd oper

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>groupadd apache

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>useradd -g dba -G oinstall oracle  ;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>useradd -g dba -G oinstall apache

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>usermod oracle -G root

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod -R 775 /dev

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir /orac

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 /dev/nb*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 /dev/raw*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 777 /dev/raw/*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown oracle:dba /dev/nb*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown oracle:dba /dev/raw*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown oracle:dba /dev/raw/*

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown -R oracle:dba /orac

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cp /etc/redhat-release /etc/redhat-release.bak <span style='color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo redhat-3 &gt; /etc/redhat-release <span style='color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir -p /u01/app/oracle/product/9.2.0.1.0 <span style='color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown -R oracle:dba /u01

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir /var/opt/oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>touch /var/opt/oracle/srvConfig.loc

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown -R oracle:dba /var/opt/oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod -R 775 /u01

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>passwd oracle; passwd apache

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#003366'>

<p class=MsoNormal> Type password for oracle and apache user

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#003366'>

<p class=MsoNormal><b> 9.2 Only On Node1 DataFile </b>

<p class=MsoNormal>

<p class=MsoNormal> Login as root and run following command

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cat &gt; /orac/datafiles.conf &lt;&lt;EOF

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>system=/orac/system_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>users=/orac/users_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>temp=/orac/temp_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>undotbs1=/orac/undo_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>undotbs2=/orac/undo_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>indx=/orac/indx_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>tools=/orac/tools_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>control1=/orac/controlfile_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>control2=/orac/controlfile_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>redo1_1=/orac/redo1_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>redo1_2=/orac/redo1_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>redo2_1=/orac/redo2_1_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>redo2_2=/orac/redo2_2_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>spfile=/orac/spfile_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>srvconfig_loc=/orac/srvctl_raw

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>EOF

<p class=MsoNormal>

<p class=MsoNormal><b> 9.3 On Both Nodes Setup Oracle Environment </b>

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal><b> Add following lines to oracle's .bash_profile on both nodes and make sure that oracle_sid should be unique </b>

<p class=MsoNormal>

<p class=MsoNormal><b> Example </b> on node1 “ORACLE_SID= test1 ; export ORACLE_SID” and on node2 “ORACLE_SID= test2 ; export ORACLE_SID”

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ORACLE_HOME=$ORACLE_BASE/product/9.2.0.1.0; export ORACLE_HOME

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ORACLE_TERM=xterm; export ORACLE_TERM

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>PATH=$ORACLE_HOME/bin:$PATH; export PATH

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ORACLE_OWNER=oracle; export ORACLE_OWNER

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ORACLE_SID= <b><span style='font-size:10.0pt;font-family: Verdana;color:red'>test1 </b><span style='font-size:10.0pt;font-family: Verdana;color:green'>; export ORACLE_SID

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>LD_LIBRARY_PATH=$ORACLE_HOME/lib; export LD_LIBRARY_PATH

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>LD_ASSUME_KERNEL=2.4.1; export LD_ASSUME_KERNEL

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>THREADS_FLAG=native; export THREADS_FLAG

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>TMP=/tmp; export TMP

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>TMPDIR=$TMP; export TMPDIR

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>DBCA_RAW_CONFIG=/orac/datafiles.conf

<p class=MsoNormal>

<p class=MsoNormal><b> 9.4 On Both Nodes Setup RSH </b>

<p class=MsoNormal>

<p class=MsoNormal> Check if rsh-server is installed with command

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>rpm –q rsh-server

<p class=MsoNormal>

<p class=MsoNormal> If it is not there, install it from cd with command

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>rpm -ivh rsh-server-0.17-19.i386.rpm

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig rsh on

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig rlogin on

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chkconfig xinetd on

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>service xinetd restart

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>touch /etc/hosts.equiv

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod 600 /etc/hosts.equiv

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chown root.root /etc/hosts.equiv

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;+node1 oracle&quot; &gt;&gt; /etc/hosts.equiv

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;+node2 oracle&quot; &gt;&gt; /etc/hosts.equiv

<p class=MsoNormal>

<p class=MsoNormal><b> 9.5 On Both Nodes Configure /etc/hosts </b>

<p class=MsoNormal>

<p class=MsoNormal> Give unique static IP addresses to both node1 and node2. Edit /etc/hosts of both the node and add there IP addresses in /etc/hosts

<p class=MsoNormal>

<p class=MsoNormal> e.g.

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#339966'>127.0.0.1 localhost localhost.localdomain

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#339966'>10.1.1.1 node1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#339966'>10.1.1.2 node2

<p class=MsoNormal>

<p class=MsoNormal><b> 9.6 Test Network Settings </b>

<p class=MsoNormal>

<p class=MsoNormal> From node1 try to ping node1 (i.e. ping itself) and make sure that it is pinging to correct IP and NOT 127.0.0.1

<p class=MsoNormal> From node1 try to ping to node2 and make sure it is pining to correct ipaddress of node2

<p class=MsoNormal> From node2 try to ping node2 (i.e. ping itself) and make sure that it is pinging to correct IP and NOT 127.0.0.1

<p class=MsoNormal> From node2 try to ping to node1 and make sure it is pining to correct ipaddress of node1

<p class=MsoNormal> on node1, run command hostname and make sure it returns node1 and not localhost or localhost.localdomain

<p class=MsoNormal> if you are getting someting else, change HOSTNAME=node1 in /etc/sysconfig/network and reboot system

<p class=MsoNormal> on node2, run command hostname and make sure it returns node2 and not localhost or localhost.localdomain

<p class=MsoNormal> if you are getting someting else, change HOSTNAME=node2 in /etc/sysconfig/network and reboot system

<p class=MsoNormal> on node1 login as root and run 2 commands su - oracle followed by rsh node2 and you should be able to login to node2 without any password

<p class=MsoNormal> on node2 login as root and run 2 commands su - oracle followed by rsh node1 and you should be able to login to node1 without any password

<p class=MsoNormal>

<p class=MsoNormal><b> 10 Oracle Installation </b>

<p class=MsoNormal>

<p class=MsoNormal><b> 10.1 On Both Nodes Login as root in GUI and apply patch p3006854_9204_LINUX.zip </b>

<p class=MsoNormal>

<p class=MsoNormal> go to directory where patch is downloaded

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>unzip p3006854_9204_LINUX.zip

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd 3006854/

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>sh rhel3_pre_install.sh

<p class=MsoNormal>

<p class=MsoNormal><b> 10.2 On Node1 Install Oracle Cluster Manager software </b>

<p class=MsoNormal>

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, <st1:place w:st="on"><st1:PlaceType w:st="on">mount</st1:PlaceType> <st1:PlaceName w:st="on">cdrom</st1:PlaceName></st1:place> and start installation

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mount /mnt/cdrom

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /mnt/cdrom/Disk1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>./runInstaller

<p class=MsoNormal>

<p class=MsoNormal> At the &quot;Welcome Screen&quot;, click Next.

<p class=MsoNormal> If the &quot;Inventory Location&quot; screen appears, enter the inventory location then click OK.

<p class=MsoNormal> If the &quot;Unix Group Name&quot; screen appears, enter the unix group name dba then click Next.

<p class=MsoNormal> At this point you may be prompted to run /tmp/orainstRoot.sh on both nodes. Run this (on both nodes if prompted) and click Continue.

<p class=MsoNormal> At the &quot;File Locations Screen&quot;, verify the destination listed is your ORACLE_HOME directory. Also enter a name ORACLE_HOME.

<p class=MsoNormal> At the &quot;Available Products Screen&quot;, Check &quot;Oracle Cluster Manager&quot;. Click Next.

<p class=MsoNormal> At the public node information screen, enter the public node names node1 and node2. Click Next.

<p class=MsoNormal> At the private node information screen, enter the interconnect node names node1 and node2. Click Next.

<p class=MsoNormal> Enter the full name of the file or raw device /orac/CMQuorumFileQuorum. Click Next.

<p class=MsoNormal> Press Install at the summary screen.

<p class=MsoNormal> You will now briefly get a progress window followed by the end of installation screen. Click Exit and confirm by clicking Yes.

<p class=MsoNormal>

<p class=MsoNormal><b> 10.3 On Both Nodes, Install Version 10.1.0.2 of the Oracle Universal Installer </b>

<p class=MsoNormal>

<p class=MsoNormal> From root user login, Create a directory /software/9205

<p class=MsoNormal> Download the 9.2.0.5 patchset from MetaLink - Patches: Enter 3501955 in the Patch Number field.

<p class=MsoNormal> move the patch p3501955_9205_LINUX.zip in /software/9205

<p class=MsoNormal> Unzip it and change permission to 777 of /software/9205 so that oracle user can use it.

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, got to /software/9205/Disk1 and start installation

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir -p /software/9205

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mv /path/to/p3501955_9205_LINUX.zip /software/9205

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /software/9205

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>unzip p3501955_9205_LINUX.zip

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cpio -idmv &lt; 9205_lnx32_release.cpio

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>chmod -R 777 /software

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; color:navy;mso-ansi-language:DA'>su - oracle <span lang=DA style='mso-ansi-language:DA'>

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; color:navy;mso-ansi-language:DA'>cd /software/9205/Disk1 <span lang=DA style='mso-ansi-language:DA'>

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; color:navy;mso-ansi-language:DA'>./runInstaller <span lang=DA style='mso-ansi-language:DA'>

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; mso-ansi-language:DA'>

<p class=MsoNormal> At the &quot;Welcome Screen&quot;, click Next.

<p class=MsoNormal> At the &quot;File Locations Screen&quot;, Change the $ORACLE_HOME name from the dropdown list to ORACLE_HOME. Click Next.

<p class=MsoNormal> On the &quot;Available Products Screen&quot;, Check &quot;Oracle Universal Installer 10.1.0.2&quot;. Click Next.

<p class=MsoNormal> Press Install at the summary screen.

<p class=MsoNormal> You will now briefly get a progress window followed by the end of installation screen. Click Exit and confirm by clicking Yes.

<p class=MsoNormal>

<p class=MsoNormal> Remember to install the 10.1.0.2 Installer on ALL cluster nodes.

<p class=MsoNormal> Note that you may need to change the 9.2 $ORACLE_HOME name to &quot;<span style='color:green'>ORACLE_HOME &quot;, on the &quot;File Locations Screen&quot; for other nodes.

<p class=MsoNormal> It will ask if you want to specify a non-empty directory, say &quot;Yes&quot;.

<p class=MsoNormal>

<p class=MsoNormal><b> 10.4 On Both Nodes, Run the 10.1.0.2 Oracle Universal Installer to patch the Oracle Cluster Manager (ORACM) to 9.2.0.5 </b>

<p class=MsoNormal>

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, got to /software/9205/Disk1 and start installation

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /software/9205/Disk1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>./runInstaller

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> At the &amp;quot;Welcome Screen&quot;, click Next.

<p class=MsoNormal> At the &quot;File Locations Screen&quot;, make sure the source location is to the products.xml file in the 9.2.0.5 patchset location under /software/9205/Disk1.

<p class=MsoNormal> Also verify the destination listed is your ORACLE_HOME directory. Change the $ORACLE_HOME name from the dropdown list to &quot;ORACLE_HOME&quot;. Click Next.

<p class=MsoNormal> At the &quot;Available Products Screen&quot;, Check &quot;Oracle9iR2 Cluster Manager 9.2.0.5.0&quot;. Click Next.

<p class=MsoNormal> At the public node information screen, enter the public node names node1 and node2.click Next.

<p class=MsoNormal> At the private node information screen, enter the interconnect node names node1 and node2. Click Next.

<p class=MsoNormal> Click Install at the summary screen.

<p class=MsoNormal> You will now briefly get a progress window followed by the end of installation screen. Click Exit and confirm by clicking Yes.

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal><b> 10.5 On Node1 Modify the ORACM configuration files to utilize the hangcheck-timer </b>

<p class=MsoNormal> 

<p class=MsoNormal> Login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, cd to directory $ORACLE_HOME/oracm/admin/

<p class=MsoNormal> Edit file cmcfg.ora

<p class=MsoNormal>

<p class=MsoNormal> Make sure the contents of cmcfg.ora are as follows

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ClusterName=Oracle Cluster Manager, version 9i

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>MissCount=250

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>PrivateNodeNames=node1 node2

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>PublicNodeNames=node1 node2

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ServicePort=9998

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>CmDiskFile=/orac/CMQuorumFile

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>KernelModuleName=hangcheck-timer

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>HostName=node1

<p class=MsoNormal>

<p class=MsoNormal><b> 10.6 On Node2 Create log directory and Modify the ORACM configuration files to utilize the hangcheck-timer </b>

<p class=MsoNormal>

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, cd to directory $ORACLE_HOME/oracm/

<p class=MsoNormal> Create directory log under $ORACLE_HOME/oracm

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir $ORACLE_HOME/oracm/log

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> cd to directory $ORACLE_HOME/oracm/admin

<p class=MsoNormal> edit file cmcfg.ora

<p class=MsoNormal>

<p class=MsoNormal> Make sure the contents of cmcfg.ora are as follows

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ClusterName=Oracle Cluster Manager, version 9i

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>MissCount=250

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>PrivateNodeNames=node1 node2

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>PublicNodeNames=node1 node2

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>ServicePort=9998

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>CmDiskFile=/orac/CMQuorumFile

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>KernelModuleName=hangcheck-timer

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>HostName=node2

<p class=MsoNormal>

<p class=MsoNormal><b> 10.7 On Both Nodes Modify Oracle Cluster Manager Startup Script </b>

<p class=MsoNormal>

<p class=MsoNormal> Login as root, su - oracle and edit file <span style='color:#993366'>$ORACLE_HOME/oracm/bin/ocmstart.sh Add following line in the beginning of this file i.e. on line 1

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:green'>/bin/rm /u01/app/oracle/product/9.2.0.1.0/oracm/log/*

<p class=MsoNormal>

<p class=MsoNormal><b> 10.8 On Both Nodes Start the ORACM (Oracle Cluster Manager) </b>

<p class=MsoNormal>

<p class=MsoNormal> On Both Nodes Verify that raw devices are accessible with command rawtest, if you get any error, restart nbd service on node1 first then on node2.

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, run command rawtest

<p class=MsoNormal>

<p class=MsoNormal> Make sure that you don't get any error like &quot;Input/output error&quot;

<p class=MsoNormal> cd to directory $ORACLE_HOME/oracm/bin, su to root, ./ocmstart.sh

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>rawtest color:navy'>Make sure that you don't get any error like &quot;Input/output error&quot;
 * 1) <span style='font-size:10.0pt;font-family:Verdana;

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd $ORACLE_HOME/oracm/bin

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su root

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>./ocmstart.sh

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> Verify that ORACM is running with the following command

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>ps -ef | grep oracm

<p class=MsoNormal>

<p class=MsoNormal> Make sure you see many oracm process. If not see error in $ORACLE_HOME/oracm/log/cm.log

<p class=MsoNormal> Also verify that the ORACM version is the same on each node

<p class=MsoNormal>

<p class=MsoNormal> #<span style='color:navy'>cd $ORACLE_HOME/oracm/log

<p class=MsoNormal> #<span style='color:navy'>head -1 cm.log

<p class=MsoNormal> oracm, version[ 9.2.0.2.0.49 ] started {Fri May 14 09:22:28 2004 }

<p class=MsoNormal>

<p class=MsoNormal><b> 10.9 On Both Nodes Install 9.2.0.4 RAC Database </b>

<p class=MsoNormal> 

<p class=MsoNormal> Note: Due to bug 3547724, temporarily create a symbolic link /oradata directory pointing to an oradata directory with space available as root prior to running the RAC install:

<p class=MsoNormal>

<p class=MsoNormal> # <span style='color:navy'>mkdir -p /u04/oradata

<p class=MsoNormal> #<span style='color:navy'> chmod 777 /u04/oradata

<p class=MsoNormal> # <span style='color:navy'>ln -s /u04/oradata /oradata

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, <st1:place w:st="on"><st1:PlaceType w:st="on">mount</st1:PlaceType> <st1:PlaceName w:st="on">cdrom</st1:PlaceName></st1:place> , go to /mnt/cdrom and start installation

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mount /mnt/cdrom

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /mnt/cdrom/Disk1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>./runInstaller

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> At the &quot;Welcome Screen&quot;, click Next.

<p class=MsoNormal> At the &quot;Cluster Node Selection Screen&quot;, make sure that all RAC nodes are selected.

<p class=MsoNormal> At the &quot;File Locations Screen&quot;, verify the destination listed is your ORACLE_HOME directory and that the source directory is pointing to the products.jar from the 9.2.0.4 cd or staging location.

<p class=MsoNormal> At the &quot;Available Products Screen&quot;, check &quot;Oracle 9i Database 9.2.0.4&quot;. Click Next.

<p class=MsoNormal> At the &quot;Installation Types Screen&quot;, check &quot;Enterprise Edition&quot;, click Next.

<p class=MsoNormal> At the &quot;Database Configuration Screen&quot;, check &quot;Software Only&quot;. Click Next.

<p class=MsoNormal> At the &quot;Shared Configuration File Name Screen&quot;, enter the path of the CFS or NFS srvm raw device /orac/srvm. Click Next.

<p class=MsoNormal> Click Install at the summary screen. Note that some of the items installed will say &quot;9.2.0.1&quot; for the version, this is normal because only some items needed to be patched up to 9.2.0.4.

<p class=MsoNormal> You will now get a progress window, run root.sh when prompted.

<p class=MsoNormal> You will then see the end of installation screen. Click Exit and confirm by clicking Yes.

<p class=MsoNormal>

<p class=MsoNormal> Note: You can now remove the /oradata symbolic link:

<p class=MsoNormal>

<p class=MsoNormal> # <span style='color:navy'>rm /oradata

<p class=MsoNormal>

<p class=MsoNormal><b> 10.10 On Both Nodes Patch the RAC Installation to 9.2.0.5 </b>

<p class=MsoNormal>

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, got to /software/9205/Disk1 and start installation

<p class=MsoNormal>

<p class=MsoNormal> To do this, in root user GUI terminal run following commands,

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>cd /software/9205/Disk1

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>./runInstaller

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> At the &quot;Welcome Screen&quot;, click Next.

<p class=MsoNormal> View the &quot;Cluster Node Selection Screen&quot;, click Next.

<p class=MsoNormal> At the &quot;File Locations Screen&quot;, make sure the source location is to the products.xml file in the 9.2.0.5 patchset location under Disk1/stage.

<p class=MsoNormal> Verify the destination listed is your ORACLE_HOME directory. Change the $ORACLE_HOME name from the dropdown list to the 9.2 $ORACLE_HOME name. Click Next.

<p class=MsoNormal> At the &quot;Available Products Screen&quot;, Check &quot;Oracle9iR2 PatchSets 9.2.0.5.0&quot;. Click Next.

<p class=MsoNormal> Click Install at the summary screen.

<p class=MsoNormal> You will now get a progress window, run root.sh when prompted.

<p class=MsoNormal> You will then see the end of installation screen. Click Exit and confirm by clicking Yes.

<p class=MsoNormal>

<p class=MsoNormal><b> 10.11 On Both Nodes Create srvConfig.loc </b>

<p class=MsoNormal>

<p class=MsoNormal> login as root and run following commands

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>mkdir -p /var/opt/oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>echo &quot;srvconfig_loc=/orac/srvm&quot; &gt; /var/opt/oracle/srvConfig.loc

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; color:navy;mso-ansi-language:DA'>chown -R oracle:dba /var/opt/oracle <span lang=DA style='mso-ansi-language:DA'>

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; color:navy;mso-ansi-language:DA'>chmod -R 755 /var/opt/oracle <span lang=DA style='mso-ansi-language:DA'>

<p class=MsoNormal><span lang=DA style='font-size:10.0pt;font-family:Verdana; mso-ansi-language:DA'>

<p class=MsoNormal><b> 10.12 On Both Nodes Start The GSD (Global Service Daemon) </b>

<p class=MsoNormal>

<p class=MsoNormal> Login as root and run commands

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>gsdctl start

<p class=MsoNormal>

<p class=MsoNormal> You should see &quot;Successfully started GSD on local node&quot;

<p class=MsoNormal>

<p class=MsoNormal> Then check the status with command

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>gsdctl stat

<p class=MsoNormal>

<p class=MsoNormal> You should see &quot;GSD is running on the local node&quot;

<p class=MsoNormal>

<p class=MsoNormal> If the GSD does not stay up, try running 'srvconfig -init -f ' from the OS prompt.

<p class=MsoNormal>

<p class=MsoNormal><b> 10.13 On Both Nodes Create Listener Using command netca </b>

<p class=MsoNormal> 

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, and run following commands

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>netca

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>

<p class=MsoNormal> Slect &quot;Cluster Configuration&quot;. Click Next

<p class=MsoNormal> Click &quot;Select all nodes&quot;. Click Next

<p class=MsoNormal> Click &quot;Listener configuration&quot;.Click Next

<p class=MsoNormal> Click &quot;Add&quot;.Click Next

<p class=MsoNormal> Lister name:LISTENER. Click Next

<p class=MsoNormal> Selected Protocols: TCP. Click Next

<p class=MsoNormal> Click &quot;Use the standard port number of 1521&quot;. Click Next

<p class=MsoNormal> Click on &quot;No&quot;. Click Next

<p class=MsoNormal> Click Next

<p class=MsoNormal> Click &quot;Finish&quot;

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal><b> 10.14 On Both Nodes, make sure all raw devices are working </b>

<p class=MsoNormal>

<p class=MsoNormal> On Both Nodes Verify that raw devices are accessible with command <span style='color:navy'>rawtest, if you get any error, restart nbd service on node1 first then on node2.

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, run 'xhost +', su to oracle, run command rawtest

<p class=MsoNormal>

<p class=MsoNormal> Make sure that you don't get any error like &quot;Input/output error&quot;

<p class=MsoNormal>

<p class=MsoNormal><b> 10.15 Only From Node1 Create a RAC Database using command dbca (Oracle Database Configuration Assistant) </b>

<p class=MsoNormal>

<p class=MsoNormal> login as &quot;root&quot; in GUI, open terminal, and run following commands

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>xhost +

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>su - oracle

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>dbca

<p class=MsoNormal>

<p class=MsoNormal> Choose Oracle Cluster Database option and select Next.

<p class=MsoNormal> The Operations page is displayed. Choose the option Create a Database and click Next.

<p class=MsoNormal> The Node Selection page appears. Select the nodes that you want to configure as part of the RAC database and click Next.

<p class=MsoNormal> The Database Templates page is displayed. The templates other than New Database include datafiles. Choose New Database and then click Next. Note: The Show Details button provides information on the database template selected.

<p class=MsoNormal> DBCA now displays the Database Identification page. Enter the Global Database Name and Oracle System Identifier (SID) as test.

<p class=MsoNormal> The Database Options page is displayed. Select the options you wish to configure and then choose Next. Note: If you did not choose New Database from the Database Template page, you will not see this screen.

<p class=MsoNormal> Select the connection options desired from the Database Connection Options page. Click Next.

<p class=MsoNormal> DBCA now displays the Initialization Parameters page. This page comprises a number of Tab fields. Modify the Memory settings if desired and then select the File Locations tab to update information on the Initialization Parameters filename and location. The option Create persistent initialization parameter file is selected by default. Enter raw device name /orac/spfile_raw for the location of the server parameter file (spfile) must be entered. The button File Location Variables… displays variable information. The button All Initialization Parameters… displays the Initialization Parameters dialog box. This box presents values for all initialization parameters and indicates whether they are to be included in the spfile to be created through the check box, included (Y/N). Instance specific parameters have an instance value in the instance column. Complete entries in the All Initialization Parameters page and select Close. Note: There are a few exceptions to what can be altered via this screen. Ensure all entries in the Initialization Parameters page are complete and select Next.

<p class=MsoNormal> DBCA now displays the Database Storage Window. This page allows you to enter file names for each tablespace in your database.

<p class=MsoNormal> The Database Creation Options page is displayed. Ensure that the option Create Database is checked and click Finish.

<p class=MsoNormal> The DBCA Summary window is displayed. Review this information and then click OK. Once you click the OK button and the summary screen is closed, it may take a few moments for the DBCA progress bar to start. DBCA then begins to create the database according to the values specified.

<p class=MsoNormal>

<p class=MsoNormal> During the database creation process, you may see the following error:

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:#FF9900'>ORA-29807: specified operator does not exist

<p class=MsoNormal>

<p class=MsoNormal> This is a known issue (bug 2925665). You can click on the &quot;Ignore&quot; button to continue. Once DBCA has completed database creation, remember to run the 'prvtxml.plb' script from $ORACLE_HOME/rdbms/admin independently, as the user SYS. It is also advised to run the 'utlrp.sql' script to ensure that there are no invalid objects in the database at this time.

<p class=MsoNormal>

<p class=MsoNormal> A new database now exists. It can be accessed via Oracle SQL*PLUS or other applications designed to work with an Oracle RAC database.

<p class=MsoNormal>

<p class=MsoNormal> Login as root su – oracle and run following command to check if both instances of oracle are running or not

<p class=MsoNormal>

<p class=MsoNormal><span style='font-size:10.0pt;font-family:Verdana; color:navy'>$srvctl status database -d test

<p class=MsoNormal>

<p class=MsoNormal><b> 10.16 Administering Real Application Clusters Instances </b>

<p class=MsoNormal>

<p class=MsoNormal> Oracle Corporation recommends that you use SRVCTL to administer your Real Application Clusters database environment. SRVCTL manages configuration information that is used by several Oracle tools. For example, Oracle Enterprise Manager and the Intelligent Agent use the configuration information that SRVCTL generates to discover and monitor nodes in your cluster. Before using SRVCTL, ensure that your Global Services Daemon (GSD) is running after you configure your database. To use SRVCTL, you must have already created the configuration information for the database that you want to administer. You must have done this either by using the Oracle Database Configuration Assistant (DBCA), or by using the srvctl add command as described below.

<p class=MsoNormal> To display the configuration details for, example, database test, on nodes node1 and node2 with instances node1 and node2 run:-

<p class=MsoNormal> Login as root

<p class=MsoNormal> Su to oracle with command su - oracle

<p class=MsoNormal> $ <span style='color:navy'>srvctl config

<p class=MsoNormal> test

<p class=MsoNormal>

<p class=MsoNormal> $ <span style='color:navy'>srvctl config -p test -n node1

<p class=MsoNormal> node1 test1 /u01/app/oracle/product/9.2.0.1.0

<p class=MsoNormal>

<p class=MsoNormal> $ <span style='color:navy'>srvctl status database -d test

<p class=MsoNormal> Instance test1 is running on node node1

<p class=MsoNormal> Instance test2 is running on node node2

<p class=MsoNormal> Examples of starting and stopping RAC follow:-

<p class=MsoNormal>

<p class=MsoNormal> $ <span style='color:navy'>srvctl start database -d test

<p class=MsoNormal> $ <span style='color:navy'>srvctl stop database -d test

<p class=MsoNormal> $ <span style='color:navy'>srvctl stop instance -d test -i node2

<p class=MsoNormal> $ <span style='color:navy'>srvctl start instance -d test -i node2

<p class=MsoNormal>

<p class=MsoNormal> For further information on srvctl and gsdctl see the Oracle9i Real Application Clusters Administration manual.

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal><b> 11. Reference </b>

<p class=MsoNormal>

<p class=MsoNormal> 1. Metalink Document ID: 184821.1

<p class=MsoNormal> 2. http://www.oracle-base.com/Articles/9i/Oracle9iInstallationOnFedora1.php

<p class=MsoNormal> 3. http://www.puschitz.com/InstallingOracle9iRAC.shtml

<p class=MsoNormal>

<p class=MsoNormal>

<p class=MsoNormal> -Swapnil Durgade

<p class=MsoNormal> Email: swapnil_durgade@yahoo.com

<p class=MsoNormal> Date: 05-Jan-2006