Friday, 11 February 2011

Oracle Backup and Recovery for a VLDB (Very Large Database)

There is an ongoing focus for businesses to minimise downtime and increase operational continuity. With such challenges, IT staff are constantly under pressure to meet such demands. For DBAs, backup and recovery is one of the key areas which can be reviewed to ensure that a faster approach to recovery can be achieved to reduce downtime.

An RMAN feature called Incremental Merge (also referred to as Incremental Updated) Backups can significantly reduce recovery time if configured correctly. Perhaps not as widely used but has been around since 10g, it is the ideal backup methodology for a VLDB (Very Large Database). How it works is that the image copies of the data files are created and incrementals are then applied rolling forward the image copies after each backup operation. It is also important to enable fast incremental backups with BCT (Block Change Tracking). For more detailed information on BCT, please refer to the Pythian Whitepaper written by Alexander Gorbachev.

The table below lists the configuration that will be used for the following demonstration:

A. CONFIGURE BLOCK CHANGE TRACKING


1. To create block change tracking file, run the command in sqlplus as sysdba:
SQL> ALTER DATABASE ENABLE BLOCK CHANGE TRACKING
USING FILE '<patch_to_block_change_file_name>';
Example:
SQL> ALTER DATABASE ENABLE BLOCK CHANGE TRACKING
USING FILE '/u02/oradata/VLDB/bct_VLDB.ctf';
IMPORTANT NOTE: If running in a RAC configuration, the following file needs to be placed on the cluster shared file system.

2. Login to database and verify the location of data files.
[oracle@lnx01] export ORACLE_SID=VLDB; . oraenv
[oracle@lnx01] sqlplus / as sysdba
SQL> col file_name form a75
SQL> select file_id, file_name from dba_data_files
/
FILE_ID FILE_NAME
---------- --------------------------------------------------
1 /u02/oradata/VLDB/o1_mf_system_7o8kj2gt_.dbf
2 /u02/oradata/VLDB/o1_mf_sysux_2o3mt9jl_.dbf
3 /u02/oradata/VLDB/o1_mf_undotbs_1c5gb8nh_.dbf
4 /u02/oradata/VLDB/o1_mf_users_5v5db3vv_.dbf

B. CONFIGURE RMAN PARAMETERS


1. Register database with RMAN Catalog if using Catalog mode. See example here.

2. Connect to RMAN in catalog (or no catalog) mode.
[oracle@lnx01] export ORACLE_SID=VLDB; . oraenv
[oracle@lnx01] rman target / catalog rman/@RMANCAT
3. Configure the preferred RMAN Recovery Window. In the example, the recovery window will be 3 days.
RMAN> CONFIGURE RETENTION POLICY TO RECOVERY WINDOW OF 3 DAYS;
4. It is also recommended that you enable autobackup of controlfile in RMAN.
RMAN> CONFIGURE CONTROLFILE AUTOBACKUP ON;

C. Performing the Incremental Merge (Updated) Backup 


1. Perform the backup of the database in RMAN, and this will create an image copy on the initial run otherwise it will apply the incrementals and rolls forward the image copies of data files.
RMAN> run
{
sql 'alter system archive log current';
recover device type disk
copy of database with tag 'MIB_UPDATE';
backup incremental level 1
for recover of copy with tag 'MIB_UPDATE' database;
sql 'alter system archive log current';
}
list copy of database tag 'MIB_UPDATE';
list backup tag 'MIB_UPDATE';
2. Repeat the previous step for any future or subsequent backups.

D. Performing the Recovery from Incremental Merge (Updated) Backup


An unexpected outage has occurred and now a recovery is required to be performed to bring the database back up quickly as possible.

1. To perform the database recovery ensure that the database in MOUNT mode.
[oracle@lnx01] export ORACLE_SID=VLDB; . oraenv
[oracle@lnx01] sqlplus / as sysdba
SQL> shutdown abort
SQL> startup mount
2. In RMAN, switch database to use image copy and then perform recovery.
RMAN> set echo on;
switch database to copy;
run {
recover database;
alter database open;
}
3. Login to database and verify the location of data files are pointing to the recovered image copies.
[oracle@lnx01] export ORACLE_SID=VLDB; . oraenv
[oracle@lnx01] sqlplus / as sysdba
SQL> col file_name form a75
SQL> select file_id, file_name from dba_data_files
/
FILE_ID FILE_NAME
---------- --------------------------------------------------
1 /u03/orafra/VLDB/datafile/o1_mf_system_6o7mj1gt_.dbf
2 /u03/orafra/VLDB/datafile/o1_mf_sysaux_6o7mj4j9_.dbf
3 /u03/orafra/VLDB/datafile/o1_mf_undotbs1_6o7ml4yx_.dbf
4 /u03/orafra/VLDB/datafile/o1_mf_users_6o7mlhl4_.dbf

E. Switching database files back to original data file location


As the database is continuing to run from where the recovered image copies are located, there may be a desire to restore it back to its original location.

This is optional, however it is recommended if you are running image copies from FRA (Fast Recovery Area).

1. Backup the database in RMAN
RMAN> run
{
ALLOCATE CHANNEL d1 TYPE DISK FORMAT '/u02/oradata/VLDB/%U.dbf';
recover
copy of database with tag 'MIB_RELOCATE';
backup incremental level 1
for recover of copy with tag 'MIB_RELOCATE' database;
release channel d1;
}
list copy of database tag 'MIB_RELOCATE';
list backup tag 'MIB_RELOCATE';
NOTE: If this is the first time of running the backup to new location, it will create the image copies of the datafiles.

2. Repeat the previous step for any future or subsequent backups until a time can be scheduled to switch back.

3. When a planned time has been scheduled and switch back can be performed, shutdown database and startup in MOUNT mode.
[oracle@lnx01] export ORACLE_SID=VLDB; . oraenv
[oracle@lnx01] sqlplus / as sysdba
SQL> shutdown immediate
SQL> startup mount 
4. Switch database to use image copy and then perform recovery.  The database will now be started using image copies which is now configure in the original data file location.
RMAN> set echo on;
switch database to copy;
run {
recover database;
alter database open;
}
5. Login to database and verify the data files are pointing to the recovered image copies back in the original location (or directory).
[oracle@lnx01] export ORACLE_SID=VLDB; . oraenv
[oracle@lnx01] sqlplus / as sysdba
SQL> col file_name form a75
SQL> select file_id, file_name from dba_data_files
/
FILE_ID FILE_NAME
---------- --------------------------------------------------
1 /u02/oradata/VLDB/data_D-VLDB_I-2643384069_TS-SYSTEM_FNO-1_cim4edhc.dbf
2 /u02/oradata/VLDB/data_D-VLDB_I-2643384069_TS-SYSAUX_FNO-2_cjm4edig.dbf
3 /u02/oradata/VLDB/data_D-VLDB_I-2643384069_TS-UNDOTBS1_FNO-3_ckm4edjj.dbf
4 /u02/oradata/VLDB/data_D-VLDB_I-2643384069_TS-USERS_FNO-4_clm4edk2.dbf

F. CONSIDERATIONS 

In conclusion, it is worth noting that when using RMAN Incremental Merge (Updated) Backup strategy, it is important to consider the following:



  • More storage is required to store the copy of database in addition to the traditional incremental backups.
  • For Point-In-Time recovery, continue to at least perform one full backup of database and include archive logs.  This can be can be performed less frequently (ie weekly, fortnightly, monthly).
  • Validate image copies and backups to detect if there is corruption or missing files which may compromise recovery.
  • Image copies of database should be on same storage tier as online data files to ensure performance it is not impacted when switching to database copy for recovery.
  • Image copies do not have to be stored in FRA, but should be stored on disk.


  • Sunday, 24 October 2010

    Installing 11.1 Enterprise Manager Grid Control

    Oracle Enterprise Manager Grid Control 11g interface may have the same look and feel as the Grid Control 10g, but under the hood it is quite different. In version 10g, the OMS was a J2EE (OC4J) application deployed on the Oracle Application Server. Whereas in version 11g, the OMS is deployed on Web Logic Server (WLS) .
    For this post, I have provided some simple steps on how to install the Grid Control with minimal pain.
    The table below lists the configuration that will be used for the following demonstration.
    Product SoftwareVersionHostEnvironment Settings
    GC Repository Home11.2.0.1mama.earth.comORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1
    GC Repository SID11.2.0.1mama.earth.comORACLE_SID=GCREP
    JDK1.6 Update 18oem.earth.comJDK_HOME=/u01/jdk16
    Middleware Home11.1.0.1oem.earth.comMW_HOME=/u01/app/oracle/Middleware
    Webtier11.1.1.2oem.earth.comWT_HOME=/u01/app/oracle/Middleware/Oracle_WT
    Web Logic Server (WLS) Home10.3.2.0oem.earth.comWL_HOME=/u01/app/oracle/Middleware/wlserver_10.3
    WLS Instance Base10.3.2.0oem.earth.comWLS_INSTANCE_BASE=/u01/app/oracle/gc_inst
    WLS Instance Home10.3.2.0oem.earth.comORACLE_INSTANCE=/u01/app/oracle/gc_inst/WebTierIH1
    WLS Domain (GCDomain)10.3.2.0oem.earth.comWLS_DOMAIN=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain
    OMS11.1.0.1oem.earth.comORACLE_HOME=/u01/app/oracle/Middleware/oms11g
    Agent11.1.0.1oem.earth.comORACLE_HOME=/u01/app/oracle/Middleware/agent11g
    * SYSMAN is actually the application schema created in the GC. This is also the super administrator for logging into the EM Console.

    SECTION 1 –PRE- INSTALLION TASKS

    1. Verify the OS platform and supported Database version for the Grid Control Repository that is intended to be installed is supported. See My Oracle SupportNote 412431.1 for further details.
    2. Install the Database software and create a Database for the Grid Control Repository. A good example can be found here:
    http://blog.ronnyegner-consulting.de/2009/09/14/oracle-11g-release-install-guide-install-single-database
    NOTE: When creating the database do not configure Enterprise Manager during this step.
    3. As per Grid Control installation manual, make sure the pre-requisites are met as mentioned at:
    NOTE: For this exercise, the repository was created on mama.earth.com and service name is GCREP

    SECTION 2 – INSTALL JDK SOFTWARE

    4. Download JDK 1.6 (6.0) from http://java.sun.com/products/archive/
    NOTE: According to My Oracle Support Note 1063762.1 make sure that the JDK version 1.6 Update 18 is used for installation of WebLogic on Linux 64-bit (x86_64) platform.
    5. Create the base directory for JDK and copy the file jdk-6u18-<os_platform>.bin to the new directory.
    oracle@oem[]$ mkdir -p /u01/jdk16
    oracle@oem[]$ cp –rp jdk-6u18-linux-x64.bin /u01/jdk16
    6. Run the JDK installation
    oracle@oem[]$ cd /u01/jdk16
    oracle@oem[]$ ./jdk-6u18-linux-x64.bin
    7. Reivew the License Agreement and then click on <SPACE BAR> to continue until the following prompt is reached:
    Do you agree to the above license terms? [yes or no]
    8. Type yes to continue
    yes
    9. Click on <ENTER> to continue
    Press Enter to continue.....
    10. This should now complete the installation for JDK.
    Done.
    11. Verify that the new JDK directory jdk1.6.0_18 has been created.
    oracle@oem[]$ ls
    jdk1.6.0_18

    SECTION 3 – WEBLOGIC INSTALLATION

    NOTE: For this example, the installation will be performed on linux 64-bit platform, hence the Generic file version will be downloaded. If running windows (32bit – x86) or Sun (64bit – SPARC) then please download the alternative as listed below.
    2. Set Local Display and then run via an X session to host:
    oracle@oem[]$ xhost +
    oracle@oem[]$ ssh <weblogic_host>
    oracle@oem[]$ export DISPLAY=<LOCAL_DISPLAY>:<DISPLAY_NO>
    Example:
    oracle@oem[]$ xhost +
    oracle@oem[]$ ssh oem.earth.com
    oracle@oem[]$ export DISPLAY=laptop:0
    3. Set JAVA Home to where the JDK installation path and then run the WebLogic Installer
    oracle@oem[]$ export JAVA_HOME=/u01/jdk16/jdk1.6.0_18
    oracle@oem[]$ $JAVA_HOME/bin/java -d64 -jar wls1032_generic.jar
    4. The WebLogic Installer screen now appears, to continue click on Next.
    5. Enter a new Middleware Home Directory (eg. /u01/app/oracle/Middleware) and then click on Next.
    6. Register for Security Updates, leave default and click on Next.
    7. To continue click on Yes, if you wish to ignore setup for notification of security updates.
    8. To skip configuration and continue to ignore setup for notification of security updates click on Yes.
    9. Select Typical for the installation type to perform and then click on Next.
    10. Leave default options selected for Products and Components and then click on Next.
    11. Verfy the JDK installed has been detected by the Oracle Installer for WebLogic and then click on Next.
    12. Verify the default Product Home for WebLogic Server (eg. /u01/app/oracle/Middleware/wlserver_10.3) and the click on Next.
    13. Review the Installation Summary and click on Next.
    14. Installation is now in progress …. Please wait
    15. Installation is now complete, deselect the option Run Quickstart and then click on Done.

    SECTION 4 – WEBLOGIC WDJ7 PATCH INSTALLATION (USING SMART UPDATE)

    It is strongly recommended that the Weblogic patch WDJ7 patch is applied before installing the Grid Control 11g software.
    1. Set the JAVA_HOME:
    oracle@oem[]$ export JAVA_HOME=/u01/jdk16/jdk1.6.0_18
    2. Change directory to the BSU utility directory:
    oracle@oem[]$ cd /u01/app/oracle/Middleware/utils/bsu
    oracle@oem[]$ ./bsu.sh
    3. Enter My Oracle Support* User Credentials.
    NOTE: * Requires a valid support profile registered with http://support.oracle.com
    4. Please wait as eSupport validates the user credentials.
    5. This will refresh the library of patches available for download.
    6. Complete registration for security updates or you may ignore and click onContinue.
    7. To continue click on Yes, if you wish to ignore setup for notification of security updates
    8. To skip configuration and continue to ignore setup for notification of security updates click on Yes.
    9. The Smart Update Screen should now appear. Go to the Get Patches tab and select the WDJ7 patch and then click on Download Selected.
    NOTE: Highlight Patches from the top menu and then select on Refresh View to get the latest listing of patches available for download.
    10. Say Yes, to check for conflict of each patch and then click on Ok.
    11. Please wait for validation to be completed and then click on Ok.
    12. The WDJ7 patch has now downloaded.
    13. Click on the Manage Patches, Then click on the button for WDJ7 patch located under the Apply column.
    14. Review Oracle Support notice information regarding patches, and then click on Ok to continue.
    15. Please wait for validation to be completed and then click on Ok.
    16. The patch should now appear in the top window of the Manage Patches tab. This verifies that the patch WDJ7 has been applied successfully.
    17. This completes the patch update and the Smart Update program for WebLogic can be closed. Click on File and then on Exit.

    SECTION 5 – Install Grid Control Software

    1. Downloaded the software for 11gR1 Grid Control from:
    (NOTE: Under the Full Installers (Agent,Repository, OMS and Management Packs) section, download for the appropriate files for your platform. In this demonstration the Linux 64 bit version will be the example used.)
    2. Extract all files in the same directory where the files were downloaded to:
    oracle@oem[]$ unzip GridControl_11.1.0.1.0_Linux_x86-64_1of3.zip
    oracle@oem[]$ unzip GridControl_11.1.0.1.0_Linux_x86-64_2of3.zip
    oracle@oem[]$ unzip GridControl_11.1.0.1.0_Linux_x86-64_3of3.zip
    3. Set Local Display and then run via an X session to host:
    oracle@oem[]$ xhost +
    oracle@oem[]$ ssh <weblogic_host>
    oracle@oem[]$ export DISPLAY=<LOCAL_DISPLAY>:<DISPLAY_NO>
    Example:
    oracle@oem[]$ xhost +
    oracle@oem[]$ ssh oem.earth.com
    oracle@oem[]$ export DISPLAY=laptop:0
    4. In the same directory where files were extracted to, execute the runInstaller to launch the Grid Control Installation Wizard:
    Option 1
    Run with no variable set:
    oracle@oem[]$ cd install
    oracle@oem[]$ ./runInstaller
    Option 2
    If the server has multiple hostname or alias of where the Grid Control installation is to be installed to, the ORACLE_HOSTNAME can be used to forced the Grid Control to use the preferred name
    oracle@oem[]$ ./runInstaller ORACLE_HOSTNAME=<PREFERRED_NAME>
    For example:
    oracle@oem[]$ ./runInstaller ORACLE_HOSTNAME=oem.earth.com
    5. The Grid Control Installer screen now appears.
    6. Register for Security Updates or leave default and click on Next.
    7. To continue click on Yes, if you wish to ignore setup for notification of security updates
    8. Leave default to Skip Software Updates and click on Next.
    9. The default option of Install a new Enterprise Manager system is selected. Click on Next to continue.
    10. Prerequisite checks will be performed.
    11. Any failures or warning will be reported. Resolve issues according and click on Next.
    12. Enter Passwords for the Weblogic Domain Administrator (weblogic) and Node Manager (nodemanager) and then click on Next.
    13. Enter the database connection details for where the Grid Control Repository will be deployed to.
    If the following error message below is reported, the installation has detected existing metadata objects in the Database for DB control. Otherwise continue on to the next step.
    NOTE: The DB control (standalone Enterprise Manager) may have been installed when the database was created)
    To deinstall DB control repository, run the following in a new terminal session on the database host of where the Grid Control Repository will reside:
    oracle@mama[]$ export ORACLE_SID=GCREP; . oraenv
    ORACLE_SID = [GCREP] ?
    oracle@mama[GCREP]$ emca -deconfig dbcontrol db -repos drop -SYS_PWD oracle -SYSMAN_PWD oracle
    STARTED EMCA at Aug 25, 2010 7:55:09 PM
    EM Configuration Assistant, Version 11.2.0.0.2 Production
    Copyright (c) 2003, 2005, Oracle.  All rights reserved.
    Enter the following information:
    Database SID: GCREP
    Listener port number: 1521
    Do you wish to continue? [yes(Y)/no(N)]: yes
    Aug 25, 2010 7:55:27 PM oracle.sysman.emcp.EMConfig perform
    INFO: This operation is being logged at /u01/app/oracle/cfgtoollogs/emca/GCREP/emca_2010_08_25_19_55_08.log.
    Aug 25, 2010 7:55:27 PM oracle.sysman.emcp.EMDBPreConfig performDeconfiguration
    WARNING: EM is not configured for this database. No EM-specific actions can be performed.
    Aug 25, 2010 7:55:27 PM oracle.sysman.emcp.ParamsManager checkListenerStatusForDBControl
    WARNING: Error initializing SQL connection. SQL operations cannot be performed
    Aug 25, 2010 7:55:27 PM oracle.sysman.emcp.EMReposConfig invoke
    INFO: Dropping the EM repository (this may take a while) ...
    Aug 25, 2010 7:58:04 PM oracle.sysman.emcp.EMReposConfig invoke
    INFO: Repository successfully dropped
    Enterprise Manager configuration completed successfully
    FINISHED EMCA at Aug 25, 2010 7:58:05 PM
    Then return to the Grid Control Installation wizard to continue.
    14. Set the sysman password and verify that the location of where the tablespaces will be created and then click on Next.
    15. Set the registration password for securing communications in Grid Control. Uncheck the option for “Allow only secure access to the console” and then click on Next.
    NOTE: This is the password that will be used to secure and register agents with the OMS.
    16. Reconfigure ports as required, otherwise leave default and click on Next.
    NOTE: Make sure that ports are accessible across the network.  Enable firewall policies if required.
    17. Review the Grid Control installation summary and then click on Install.
    18. Installation is now in progress, please wait …
    19. The root configuration scripts needs to be executed as recommended before proceeding.
    In a new terminal session, as the super equivalent user (eg. root) execute the allroot.sh script.
    root@oem[]# /u01/app/oracle/Middleware/oms11g/allroot.sh
    Starting to execute allroot.sh .........
    Starting to execute /u01/app/oracle/Middleware/oms11g/root.sh ......
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/oracle/Middleware/oms11g
    Enter the full pathname of the local bin directory: [/usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n)
    [n]: y
    Copying dbhome to /usr/local/bin ...
    The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
    [n]: y
    Copying oraenv to /usr/local/bin ...
    The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
    [n]: y
    Copying coraenv to /usr/local/bin ...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    Adding entry to /etc/oratab file...
    Finished execution of  /u01/app/oracle/Middleware/oms11g/root.sh ......
    Starting to execute /u01/app/oracle/Middleware/agent11g/root.sh ......
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/oracle/Middleware/agent11g
    Enter the full pathname of the local bin directory: [/usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n)
    [n]: y
    Copying dbhome to /usr/local/bin ...
    The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
    [n]: y
    Copying oraenv to /usr/local/bin ...
    The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
    [n]: y
    Copying coraenv to /usr/local/bin ...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    Finished product-specific root actions.
    Adding entry to /etc/oratab file...
    Finished execution of  /u01/app/oracle/Middleware/agent11g/root.sh ......
    Then return to the Grid Control installation wizard and then click on Ok to continue.
    20. The installation configuration assistants are now in progress. Please wait for this to complete.
    21. This now completes the installation. The following detail list how you can access the EM console and Adminstrator Console.

    SECTION 6 – Post Installation Tasks

    1. Add the following entries of the ORACLE_HOME for OMS and AGENT in the ORATAB file.
    NOTE: On linux this is located under /etc/oratab
    OMS:/u01/app/oracle/Middleware/oms11g:N
    AGENT:/u01/app/oracle/Middleware/agent11g:N
    2. Verify Web Tier is running:
    oracle@oem[]$ . oraenv
    ORACLE_SID = [] ? OMS
    oracle@oem[OMS]$ export ORACLE_INSTANCE=/u01/app/oracle/gc_inst/WebTierIH1
    oracle@oem[OMS]$ export PATH=$ORACLE_INSTANCE/bin:$PATH
    oracle@oem[OMS]$ which opmnctl
    /u01/app/oracle/gc_inst/WebTierIH1/bin/opmnctl
    oracle@oem[OMS]$ opmnctl status -l
    Processes in Instance: instance1
    ---------------------------------+--------------------+---------+----------+------------+----------+-----------+------
    ias-component                    | process-type       |     pid | status   |        uid |  memused |    uptime | ports
    ---------------------------------+--------------------+---------+----------+------------+----------+-----------+------
    ohs1                             | OHS                |   31912 | Alive    |   92828927 |   298032 |   0:42:33 | http:4889,https:4900,https:9999,https:7799,http:7788
    3. Verify that OMS is running
    oracle@oem[]$ . oraenv
    ORACLE_SID = [] ? OMS
    oracle@oem:[OMS]$ which emctl
    /u01/app/oracle/Middleware/oms11g/bin/emctl
    oracle@oem[OMS]$ emctl status oms
    Oracle Enterprise Manager 11g Release 1 Grid Control
    Copyright (c) 1996, 2010 Oracle Corporation.  All rights reserved.
    WebTier is Up
    Oracle Management Server is Up
    3. Verify that Agent (OMA) is running
    oracle@oem[]$ . oraenv
    ORACLE_SID = [] ? AGENT
    oracle@oem[AGENT] which emctl
    /u01/app/oracle/Middleware/agent11g/bin/emctl
    oracle@oem[AGENT] emctl status agent
    Oracle Enterprise Manager 11g Release 1 Grid Control 11.1.0.1.0
    Copyright (c) 1996, 2010 Oracle Corporation.  All rights reserved.
    ---------------------------------------------------------------
    Agent Version     : 11.1.0.1.0
    OMS Version       : 11.1.0.1.0
    Protocol Version  : 11.1.0.0.0
    Agent Home        : /u01/app/oracle/Middleware/agent11g
    Agent binaries    : /u01/app/oracle/Middleware/agent11g
    Agent Process ID  : 3462
    Parent Process ID : 3439
    Agent URL         : https://oem.earth.com:3872/emd/main/
    Repository URL    : https://oem.earth.com:4900/em/upload
    Started at        : 2010-10-21 20:51:47
    Started by user   : oracle
    Last Reload       : 2010-10-21 21:25:30
    Last successful upload                       : 2010-10-21 21:32:08
    Total Megabytes of XML files uploaded so far :    32.06
    Number of XML files pending upload           :        0
    Size of XML files pending upload(MB)         :     0.00
    Available disk space on upload filesystem    :    66.86%
    Last successful heartbeat to OMS             : 2010-10-21 21:31:12
    ---------------------------------------------------------------
    Agent is Running and Ready
    4. The EM and Weblogic Admin Console should now be accessible. For example:
    DescriptionURLSuper Administrator Accounts
    EM Consolehttp://oem.earth.com:7788/emsysman
    Weblogic Admin Consolehttp://oem.earth.com:7101/consoleweblogic
    NOTE: All hostname, IP addresses, URLs and ports mentioned above are used for demonstration purposes only.