ddc1cn1:~ # ff_list_services.sh -o nodesPool Group Hostname Type Stateadm SPARE ddc1-an4 spare sparep11 grp1 ddc1-an3 spare runningp11 grp1 ddc1-vm01 spare runningp12 grp1 ddc1-vm02 spare runningp12 grp1 ddc1-vm13 spare runningp13 grp1 ddc1-vm03 spare runningp13 grp1 ddc1-vm21 spare runningp14 grp1 ddc1-vm11 spare runningp14 grp1 ddc1-vm22 spare runningp15 grp1 ddc1-vm23 spare runningddc1cn1:~ # ff_an_adm.pl --op list-all --pool p12Nodes sorted by pool, group and name (output reduced to pool p12) Pool p12 Pool Group grp1 ddc1-vm02 System: ESXVM MAC Addr.: 00:50:56:0b:00:02 OS: SuSE / Linux / SLES-11.x86_64 (Vendor / Type / Version) OS Path: ddc1fas01-p12-st:/vol/volFF/os/Linux/FSC_5.1A00-020.SLES-11.x86_64 VlanID Host IP Hostname Storage LAN: 2112 10.2.112.19 ddc1-vm02-st Server LAN: 1112 10.1.112.19 ddc1-vm02-se Client LAN: 112 192.168.112.19 ddc1-vm02

ddc1-vm13 System: ESXVM MAC Addr.: 00:50:56:0b:00:06 OS: SuSE / Linux / SLES-11.x86_64 (Vendor / Type / Version) OS Path: ddc1fas01-p12-st:/vol/volFF/os/Linux/FSC_5.1A00-020.SLES-11.x86_64 VlanID Host IP Hostname Storage LAN: 2112 10.2.112.20 ddc1-vm13-st Server LAN: 1112 10.1.112.20 ddc1-vm13-se Client LAN: 112 192.168.112.20 ddc1-vm13

ddc1cn1:~ #

Go to On Filer Server ----from Control node , execute following cmd>firefox& or firefox -ProfileManager

Create Profile and then start

Goto on following url of netapp server to connect to management tool

Click on Filer View Link

Give Data Volume Name

Add one more volume for log volume by name log_p12_FOS, as did for Data volume like click on Add volume and -next

Check created data nad log volumes by click on Manager tab of Volume , see below

Management Tool Use --- to create SID and instance name and Ip address and add these entries in the LDAP Config file

Launch Mgmt tool here

Here we can change Instance number and host number as we want , see below

Its already taken 1 application instance also while I need only CI, ASCS, ERS and DB.So we can delete App server now, initial we cannot delete, once this script is done then we can delete this entry as shown belowNow click on Delete Instance Tab ,\ \Cmd to delete any app instance from cmd prompt ff_sid_adm.pl --op rem --pool p12 --sid FOS --sysnr 03

Now click on Execute button again to remove this red entry

Now IP , volumes and folder creation is done

Mount netapp filer /vol/sapcd to local application nodeGoto any one of application node of Pool p12 ,

App node > mount ddc1fas01-p12-st:/vol/sapcd /sapcd

To ping netapp server from local application node , we cannot ping it directly, we need to use by using pool name , see below

If we want to hide .snapshot dir tehn we need to goito netapp server and from there we need to hide it, see below

After doing this , snapshor dir is not visiable under /usr/sap/FOS and /oracle location, see below

1) To stop FF Agent on this host

2)start the interfaces of all hosts

2) Create install dir under /usr/sap/FOS and under that create DB, ASCS and Ci, see below

Extract sapinst /sapcd/NW73/NW73_Kernel_Master/DATA_UNITS/NW730_IM_LINUX_X86_64_ORA/sapinst extractChange umask to 022 value

Pwd : password123

Donot select ERS installation check box as we will be doing it later as ERS needs IP address for installation which it does not have so work around is there for ERS installation.

Stop sapinst here forcefully and do changes in control.xml file from /usr/sap/sapservices to /usr/sap/sapservices/sapservices.

ASCS installation took around 30 mins for installationDB installation started at 1:35 PM (CEST)

Pwd : Password123

Pwd : Password123 By default its taking listener name as LISTENER but we can change it We need to mention that new Listener name under file ora_listener_names, see below

Here I have enterned new LISTENER_FOS anme for SID FOS

Pwd used here : passwordCurrentlt ORACLE_BASE is set to /oracle,

Need to set /ORACLE_BASE to /oracle/FOS

Click on Yes Click yes

Click on Yes

Time at this import phase 3:00 PM (CEST) 16th oct 2012INFO: Transformation finished.

INFO 2012-10-16 15:39:38.602 [syuxcpath.cpp:471] CSyPath::createFile() lib=syslib module=syslibCreating file /usr/sap/FOS/install/DB/installationSuccesfullyFinished.dat.

INFO 2012-10-16 15:39:38.605 [sixxbserviceselection.cpp:812]The installation of component NW_ABAP_DB|ind|ind|ind|ind finished 16_Oct_2012_15_39_38 has completed.

CGuiProxy::receive(): connection on socket 6 closed by peerINFO 2012-10-16 15:39:38.647 [syuxcpath.cpp:471] CSyPath::createFile() lib=syslib module=syslibCreating file /var/tmp/sapinst_instdir/.lastInstallationLocation.

INFO 2012-10-16 15:39:40.694 [syuxctask.cpp:1122] CSyTaskImpl::cancel() lib=syslib module=syslibCancelled task 0.

ddc1-vm02:/usr/sap/FOS/install/DB #

DB installation is done successfully at 3:40 PM CEST on 16th oct 2012

CI Installation : started at 4PM CESTddc1-vm02:/usr/sap/FOS/install/CI # ./sapinst SAPINST_USE_HOSTNAME=cifos /sapcd/NW73/NW73_Kernel_Master/DATA_UNITS/NW730_IM_LINUX_X86_64_ORA/product.catalogddc1-vm02:/usr/sap/FOS/install/CI # vi sapinstddc1-vm02:/usr/sap/FOS/install/CI # more sapinst |grep umask# set umask to prevent unauthorized readumask 022ddc1-vm02:/usr/sap/FOS/install/CI # logoutddc1cn1:~ # ff_sid_adm.pl --op add --pool p12 --sid DAA --sapversion 7.1 --smd 97:cifoERROR Invalid service type used for SMD instance: cifoddc1cn1:~ # ff_sid_adm.pl --op add --pool p12 --sid DAA --sapversion 7.1 --smd 97:cifosddc1cn1:~ # ff_setup_sid_folder.sh -p p12 -s daaInfo: Parameters used: -p p12 -s daaInfo: Configuration file used: /opt/FlexFrame/etc/ff_setup_sid_folder.configInfo: SAP service type: smdInfo: Entered (VERSION 1.135.2.3) with POOL=p12, SID=DAA (TYPE=smd)Info: Read file/directory list from configuration fileInfo: Setting owner/access rights for files/directories (make_user_folders)Info: Creating files and directories (make_user_folders)ddc1cn1:~ #

Master pwd given Password123

Webadm pwd : Password123

Donot select above Check box ---its recommended that donot select it

Stop sapinst and then do the changes in control.xml from /usr/sap/sapservices to /usr/sap/sapservices/sapservices.

CI installation finished at 4:30 PM CEST

Note : After complete NW7.3 installation , when we do SAP Login , it throws one ABAP Dump, as shown below

Workaround for it ddc1-vm02:/FlexFame/pooldata/config/etc/init.d# vi sapinit#!/usr/bin/uname26 /bin/sh

ddc1-vm12:/etc/security# vi uname26.confadm

Sapinit file does not exist so create it and add following entry

Same with uname26.conf file

Now restart whole system to work properly by using FF scripts

Highlighted line only comes once at the time of 1st stop via FF script

Start up of FOS

To cleanup hidden files from home dir of fosadm

From oracle user orafos user home dir

Now stopped System on ddc1-vm02 server ..And starting it on another Node ddc1-vm13 to check that its working fine.But before goping to start it on another application node ddc1-vm13, create uname26.conf file under /etc/security as its application node specific file ( it comes under /var)

Started system successfully on other application node

Post installation Steps

Now its showing both app nodes of pool p12 because ff Agent is running on both nodes

TMSADM pwd : password

Operation System changes from SLSE 11 to SLSE 10 of SID FOS on pool p12 (ddc1-vm02)ff_list_services.sh -o nodes

Shutdown now -- for stop server ddci-vm02 in normal mode that is first it stop all active application services

To stop server

Stop all sap services

Now system is stoped properly and agents also stopped from both application nodeNow do power off of a application node ddc1-vm02 server

Above we can see the OS patch location that where it actually exist

CN> ff_an_adm.pl --op os --name ddc1-vm02 --ospath Linux/FSC_5.1A00-020.SLSE-10.x86_64Cmd creating OS linux10 image on local node ddc1-vm02

Now Linux/FSC_5.1A00-020.SLSE-10.x86_64 is updated under Ldap file , see below

Here /var_img does not have my pool p12 details because I have not done it till now to maintain p12 details here.It should be like After executing cmd ff_new_an.sh -f -n ddc1-vm02

Now p12 pool details is created under /var_img , see below

Highlighted p12 entry was not exist initial, but now its come after cmd ff_new_an.sh -f -n ddc1-vm02 execution.

Start / power on server

Now server ddc1-vm02 come up as I am able to login to server ddc1-vm02 and OS also changed from SLSE11 to SLSE ( as after login server prompt coming in balck colour)

Now OS is changed but SAP system would not come up because /sapmnt/FOS_exe, /oracle/FOS executables would be linking to SLSE 11 files

1st unmount /sapmnt and /oracle and after that make soft link from LINUX SLSE11 to LINUX SLSE!0

Start the system

Now OS change on another app node ddc1-vm13

Stop the server or boot the server

Updated OS SLSE 10 on server

After that system was started here without getting any error by using FF script. ( after stopping from another app node)

ERS - installation Installation

virtual IP@ has to be bound to host (ers) installation issue only Workaround use address of physical host at installation time

Workaround before sapinst ff_hosts.sh a n ers -p install ERS by sapinst after sapinst ff_hosts.sh r ers -p

Before launching sapinst for ERS installation , 1st add entry under hosts file

Add ERS entry in LDAP by cmd , see belowddc1cn1:~ # ff_hosts.sh -a 192.168.112.19 -n ers02fuj -p p12

Note : ASCS should be running before starting ERS installation on any host

ddc1-vm02:/usr/sap/FOS/install/ERS # ./sapinst SAPINST_USE_HOSTNAME=ers02fos /sapcd/NW73/NW73_Kernel_Master/DATA_UNITS/NW730_IM_LINUX_X86_64_ORA/product.catalog

Donot select check box of Get The ASCS Instance Restarted

Do the changes in control.xml file from /usr/sap/sapservices to /usr/sap/sapservices/sapservices|

Now Restrat ASCS

AFTER ASCS restart , check ensmon pf= and choose option 2