Test/Development Database Refresh From Production Procedure
The following note describes the generic procedure to be followed to refresh a Energy Test or Development environment database from a Energy production database backup.
In this example, we are refreshing the DEVE72 database from a backup taken of the PRD22 database.
The assumption here is that the required RMAN production backup has already been either copied from the production database via scp or has been restored from tape or has been placed in an NFS shared location which is accessible from both machines.
On the target machine the backups have been restored in the location u02/backup/DEVE72
Procedure:
Shutdown the DEVE72 database if it is already running
[oracle@DEVE72 DEVE72]$ ps -ef |grep pmon
oracle 12701 29275 0 15:36:00 pts/3 0:00 grep pmon
oracle 7377 2235 0 May 19 ? 84:59 ora_pmon_DEVE72
[oracle@DEVE72 DEVE72]$ echo $ORACLE_SID
DEVE72
[oracle@DEVE72 DEVE72]$ sqlplus sys as sysdba
SQL*Plus: Release 10.2.0.4.0 - Production on Thu Jun 17 15:36:22 2010
Copyright (c) 1982, 2007, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
Delete the database data files, redo log files and control files
Note:
**Ensure we are connected to the right server and are in the appropriate directory location**
[oracle@DEVE72 DEVE72]$ hostname
DEVE72
[oracle@DEVE72 DEVE72]$ pwd
/u03/oradata/DEVE72
[oracle@DEVE72 DEVE72]$ rm *.dbf
[oracle@DEVE72 DEVE72]$ cd /u04/oradata/DEVE72
[oracle@DEVE72 DEVE72]$ ls
control2.ctl redo01a.log redo02a.log redo03a.log
[oracle@DEVE72 DEVE72]$ rm *.ctl
[oracle@DEVE72 DEVE72]$ rm *.log
[oracle@DEVE72 DEVE72]$ cd /u05/oradata/DEVE72
[oracle@DEVE72 DEVE72]$ ls
control3.ctl redo01b.log redo02b.log redo03b.log
Copy the current init.ora parameter file of the DEVE72 database and create a parameter file with the name of the source production database (PRD22)
[oracle@DEVE72 ~]$ cd $ORACLE_HOME/dbs
[oracle@DEVE72 dbs]$ pwd
/u01/app/oracle/product/10.2.0/db_1/dbs
[oracle@DEVE72 dbs]$ cp initDEVE72.ora initprd22.ora
Make the following changes to the initprd22.ora
*.db_name='prd22'
Set the environment to reflect the source production database and start the instance in NOMOUNT mode
[oracle@DEVE72 dbs]$ export ORACLE_SID=prd22
[oracle@DEVE72 dbs]$ sqlplus sys as sysdba
SQL*Plus: Release 10.2.0.4.0 - Production on Mon Jun 21 12:58:32 2010
Copyright (c) 1982, 2007, Oracle. All Rights Reserved.
Enter password:
Connected to an idle instance.
SQL> startup nomount pfile=$ORACLE_HOME/dbs/initprd22.ora
ORACLE instance started.
Total System Global Area 3154116608 bytes
Fixed Size 2043904 bytes
Variable Size 637538304 bytes
Database Buffers 2499805184 bytes
Redo Buffers 14729216 bytes
SQL> quit
Restore the control file from the backup location
The control file backup exists in the format “c-<DBID>-<DATE>-<BACKUP SEQUENCE NUMBER>
Select the controlfile appropriate to the period of time that we wish to restore the database from
[oracle@DEVE72 DEVE72]$ rman target /
Recovery Manager: Release 10.2.0.4.0 - Production on Fri Jun 18 11:05:20 2010
Copyright (c) 1982, 2007, Oracle. All rights reserved.
connected to target database: prd22 (not mounted)
RMAN> restore controlfile from '/u02/backup/DEVE72/c-4031762323-20100616-00';
Starting restore at 18-JUN-10
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: sid=538 devtype=DISK
channel ORA_DISK_1: restoring control file
channel ORA_DISK_1: restore complete, elapsed time: 00:00:06
output filename=/u03/oradata/DEVE72/control1.ctl
output filename=/u04/oradata/DEVE72/control2.ctl
output filename=/u05/oradata/DEVE72/control3.ctl
Finished restore at 18-JUN-10
Mount the database
RMAN> alter database mount
2> ;
database mounted
released channel: ORA_DISK_1
Catalog the RMAN backup sets which have been copied from the source production database
RMAN> catalog start with '/u02/backup/DEVE72';
searching for all files that match the pattern /u02/backup/DEVE72
List of Files Unknown to the Database
=====================================
File Name: /u02/backup/DEVE72/c-4031762323-20100616-00
File Name: /u02/backup/DEVE72/21lgatsk_1_1
File Name: /u02/backup/DEVE72/c-2263349373-20100419-00
...
...
Do you really want to catalog the above files (enter YES or NO)? YES
cataloging files...
cataloging done
List of Cataloged Files
=======================
File Name: /u02/backup/DEVE72/c-4031762323-20100616-00
File Name: /u02/backup/DEVE72/21lgatsk_1_1
File Name: /u02/backup/DEVE72/2flgdi89_1_1
...
...
List of Files Which Where Not Cataloged
=======================================
File Name: /u02/backup/DEVE72/c-2263349373-20100419-00
RMAN-07518: Reason: Foreign database file DBID: 2263349373 Database Name: DEVE72
Note – ignore any errors reported for files that are not cataloged
Determine the last archivelog sequence included in the backup. We will be recovering the database until this particular sequence number.
Look for the string "List of archived logs"
RMAN > list backup of archivelog all
List of Archived Logs in backup set 69
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 79 7970987 16-JUN-10 7973402 16-JUN-10
In this case, the last archivelog backed up belongs to sequence number 79. If we wish to recover the database until the last archived log which has been backed up, we need to increment the last sequence number by 1. So in this case it will be 79+1 or 80
Create the following files in the location “/u02/backup/{DB_NAME}”
vi rman_head
RUN
{
# allocate a channel to the tape device
ALLOCATE CHANNEL d1 DEVICE TYPE disk;
# rename the datafiles and online redo logs
vi rman_tail
# Do a SET UNTIL to prevent recovery of the online logs
SET UNTIL SEQUENCE 80;
# restore the database and switch the datafile names
RESTORE DATABASE;
SWITCH DATAFILE ALL;
# recover the database
RECOVER DATABASE;
}
vi generate_datafiles.sql
set head off pages 0 feed off echo off verify off
set lines 200
spool rename_datafiles.lst
select 'SET NEWNAME FOR DATAFILE ' || FILE# || ' TO ''' || '/u03/oradata/&1/' || substr(name,instr(name,'/',-1)+1) || ''';' from v$datafile;
spool off
exit;
vi generate_logfiles.sql
set head off pages 0 feed off echo off
spool rename_logfiles.lst
SELECT 'SQL "ALTER DATABASE RENAME FILE '''''|| MEMBER ||'''''' ||chr(10)||'to ''''' || member || '''''" ;' FROM V$LOGFILE;
exit
Generate data file rename script
While in directory /u02/backup/{DB_NAME}, connect as sys as sysdba via SQL*PLUS session and run the generate_datafiles.sql script.
The generate_datafiles.sql script accepts a parameter which is the target database name.
SQL> @generate_datafiles DEVE72
It will create a file rename_datafiles.lst . The contents of this file will be like this:
SET NEWNAME FOR DATAFILE 1 TO '/u03/oradata/DEVE72/system01.dbf';
SET NEWNAME FOR DATAFILE 2 TO '/u03/oradata/DEVE72/undotbs01.dbf';
SET NEWNAME FOR DATAFILE 3 TO '/u03/oradata/DEVE72/sysaux01.dbf';
….
….
Generate redo log file rename script
While in directory /u02/backup/{DB_NAME}, connect as sys as sysdba via SQL*PLUS session and run the generate_logfiles.sql script.
SQL> @generate_logfiles.sql
It will create a file called rename_logfiles.lst
Edit the rename_logfiles.lst file and change values of prd22 to DEVE72
SQL "ALTER DATABASE RENAME FILE ''/u04/oradata/prd22/redo01a.log'' to ''/u04/oradata/DEVE72/redo01a.log''" ;
SQL "ALTER DATABASE RENAME FILE ''/u05/oradata/prd22/redo01b.log'' to ''/u05/oradata/DEVE72/redo01b.log''" ;
SQL "ALTER DATABASE RENAME FILE ''/u04/oradata/prd22/redo02a.log'' to ''/u04/oradata/DEVE72/redo02a.log''" ;
SQL "ALTER DATABASE RENAME FILE ''/u05/oradata/prd22/redo02b.log'' to ''/u05/oradata/DEVE72/redo02b.log''" ;
SQL "ALTER DATABASE RENAME FILE ''/u04/oradata/prd22/redo03a.log'' to ''/u04/oradata/DEVE72/redo03a.log''" ;
SQL "ALTER DATABASE RENAME FILE ''/u05/oradata/prd22/redo03b.log'' to ''/u05/oradata/DEVE72/redo03b.log''" ;
Specify the archive log sequence until which recovery will be performed
Edit the rman_tail file and change the line with the words “>> SET UNTIL SEQUENCE 80” to include the appropriate archive log sequence which was noted in an earlier step.
Prepare the RMAN restore and recover database script
[oracle@DEVE72 DEVE72]$ cat rman_head rename_datafiles.lst rename_logfiles.lst rman_tail > rman_recovery.rcv
Connect to the target database via RMAN and execute the rman_recovery.rcv script
[oracle@DEVE72 dbs]$ rman target /
Recovery Manager: Release 10.2.0.4.0 - Production on Mon Jun 21 13:04:04 2010
Copyright (c) 1982, 2007, Oracle. All rights reserved.
connected to target database (not started)
RMAN> @rman_recovery.rcv
Note:
At this stage, we can continue to recover the database and keep it in sync with the source production database by manually applying the archive log files which are copied from the production server to the log archive destination of the test
database on the target server.
We can do this via SQL*PLUS connected as SYS by issuing the command
RECOVER DATABASE UNTIL CANCEL USING BACKUP CONTROLFILE
When there are no more archive log files to apply, we enter CANCEL
Open the database with RESETLOGS
After the RMAN script has successfully run and recovered the database until the last archive log sequence, we will now open the database using the ALTER DATABASE OPEN RESETLOGS command executed either via RMAN or from SQL*PLUS connected as SYS.
SQL> alter database open resetlogs;
Database altered.
Temporary Tablespace Reconfiguration
After the restore, we will note that the temporary tablespace files are still pointing to the source production database as these tempfiles have not been renamed when we renamed all the database data files in an earlier step.
Obtain the name of the current tempfile -
SQL> select name from v$tempfile;
NAME
--------------------------------------------------------------------------------
/u03/oradata/prd22/temp01.dbf
Drop the tempfile-
SQL> ALTER DATABASE TEMPFILE '/u03/oradata/prd22/temp01.dbf' drop including datafiles;
Database altered.
Add a new tempfile for the refreshed database in the appropriate location-
SQL> ALTER TABLESPACE temp ADD TEMPFILE '/u03/oradata/DEVE72/temp01.dbf' size 2G;
Tablespace altered.
At this stage we will change the passwords if required for the SYS and SYSTEM or any other database accounts.
Change the database name using nid
We will now shutdown the database and then mount it.
We will then run the nid utility to change the database name – we need to provide the appropriate password for the user SYS and the new value we want for the database name.
[oracle@DEVE72 dbs]$ nid target=sys dbname=DEVE72
DBNEWID: Release 10.2.0.4.0 - Production on Fri Jun 18 13:55:14 2010
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Password:
Connected to database PRD22 (DBID=4031762323)
Connected to server version 10.2.0
Control Files in database:
/u03/oradata/DEVE72/control1.ctl
/u04/oradata/DEVE72/control2.ctl
/u05/oradata/DEVE72/control3.ctl
Change database ID and database name PRD22 to DEVE72? (Y/[N]) => Y
Proceeding with operation
Changing database ID from 4031762323 to 2271553224
Changing database name from PRD22 to DEVE72
Control File /u03/oradata/DEVE72/control1.ctl - modified
Control File /u04/oradata/DEVE72/control2.ctl - modified
Control File /u05/oradata/DEVE72/control3.ctl - modified
Datafile /u03/oradata/DEVE72/system01.dbf - dbid changed, wrote new name
Datafile /u03/oradata/DEVE72/undotbs01.dbf - dbid changed, wrote new name
Datafile /u03/oradata/DEVE72/sysaux01.dbf - dbid changed, wrote new name
Datafile /u03/oradata/DEVE72/users01.dbf - dbid changed, wrote new name
...
...
...
Datafile /u03/oradata/DEVE72/COGNOSPAD_CLOB01.dbf - dbid changed, wrote new name
Datafile /u03/oradata/DEVE72/temp01.dbf - dbid changed, wrote new name
Control File /u03/oradata/DEVE72/control1.ctl - dbid changed, wrote new name
Control File /u04/oradata/DEVE72/control2.ctl - dbid changed, wrote new name
Control File /u05/oradata/DEVE72/control3.ctl - dbid changed, wrote new name
Instance shut down
Database name changed to DEVE72.
Modify parameter file and generate a new password file before restarting.
Database ID for database DEVE72 changed to 2271553224.
All previous backups and archived redo logs for this database are unusable.
Database has been shutdown, open database with RESETLOGS option.
Succesfully changed database name and ID.
DBNEWID - Completed succesfully.
At this stage the database has been shutdown and now we need to mount it and issue the RESETLOGS command after the database change.
Note:
We will now set the environment to the target database (until this stage, for example, ORACLE_SID had been set to the production database value)
[oracle@DEVE72 backup] export ORACLE_SID=DEVE72
[oracle@DEVE72 backup]$ sqlplus sys as sysdba
SQL*Plus: Release 10.2.0.4.0 - Production on Mon Jun 21 14:12:00 2010
Copyright (c) 1982, 2007, Oracle. All Rights Reserved.
Enter password:
Connected to an idle instance.
SQL> startup mount
ORACLE instance started.
Total System Global Area 3154116608 bytes
Fixed Size 2043904 bytes
Variable Size 637538304 bytes
Database Buffers 2499805184 bytes
Redo Buffers 14729216 bytes
SQL> alter database open resetlogs;
Database altered.
Post Database Refresh Tasks
Create import and export directories required for Data Pump
/u02/export/{DB_NAME} - export_dir
/u02/import/{DB_NAME} - import_dir
