Skip to main content
ExLibris
  • Subscribe by RSS
    • Back
    Aleph
    Ex Libris Knowledge Center

    Server down: Oracle error 01022

    1. Last updated
    2. Save as PDF
    • Article Type: General
    • Product: Aleph
    • Product Version: 18.01

    Description:
    During the storm, the power surged and went out, bringing down the servers. The production server came back up, but the test server didn't. In the aleph_startup.log we see
    Oracle error: handle_connection
    ORA-01033: ORACLE initialization or shutdown in progress
    Oracle not running !!!
    Oracle not running, aborting.

    But we can see running Oracle server using util o /1, and the listener is running but the but the status for the server shows ERROR:ORA-01033: ORACLE initialization or shutdown in progress
    In the clsc1047.log in /exlibris/app/oracle/product/102/log/zed2/client
    SP2-0640: Not connected
    SP2-0640: Not connected
    Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
    2010-04-29 07:16:25.167: [ OCROSD]
    utgdv:2:ocr loc file cannot be opened
    2010-04-29 07:16:25.167: [ OCROSD]
    location in config file
    2010-04-29 07:16:25.167: [ OCRRAW]
    proprinit: Could not open raw device
    2010-04-29 07:16:25.168: [ default]

    2010-04-29 07:16:25.168: [ CSSCLNT]
    clsssinit: error(33 ) in OCR initialization

    [Later:]

    I looked in /exlibris/app/oracle/admin/aleph0/bdump/ since that is our instance and it hadn't been updated. Just looked in /exlibris/app/oracle/admin/aleph18/bdump/ and found it had been altered, and has:
    ALTER DATABASE OPEN
    Thu Apr 29 10:36:10 2010
    Beginning crash recovery of 1 threads
    parallel recovery started with 2 processes
    Thu Apr 29 10:36:10 2010
    Started redo scan
    Thu Apr 29 10:36:10 2010
    Errors in file /exlibris/app/oracle/admin/aleph18/udump/aleph18_ora_5033.trc:
    ORA-00600: internal error code, arguments: [kcratr1_lastbwr], [], [], [], [], [], [], []
    Thu Apr 29 10:36:11 2010
    Aborting crash recovery due to error 600
    Thu Apr 29 10:36:11 2010
    Errors in file /exlibris/app/oracle/admin/aleph18/udump/aleph18_ora_5033.trc:
    ORA-00600: internal error code, arguments: [kcratr1_lastbwr], [], [], [], [], [], [], []
    ORA-600 signalled during: ALTER DATABASE OPEN...
    Thu Apr 29 14:20:03 2010
    Starting ORACLE instance (normal)
    Cannot determine all dependent dynamic libraries for /proc/self/exe
    The open() system call failed for the file /proc/self/exe
    Linux Error: 13: Permission denied
    LICENSE_MAX_SESSION = 0
    163,1 0%
    Linux Error: 13: Permission denied

    Resolution:
    There are two KB records (8192-3639 and 8192-3143) which suggest that shutting down and restarting Oracle again eliminated these errors.

    If that doesn't work, I suggest a "manual startup" with RECOVER, as described at http://avdeo.com/2008/03/31/ora-00600-internal-error-code-arguments-kcratr1_lastbwr/ :
    Oracle is unable to perform instance recover but it works when is invoked manually.

    Solution:
    SQL> startup mount
    ORACLE instance started.

    Total System Global Area 1073741824 bytes
    Fixed Size 1264916 bytes
    Variable Size 264241900 bytes
    Database Buffers 801112064 bytes
    Redo Buffers 7122944 bytes
    Database mounted.
    SQL> recover database
    Media recovery complete.
    SQL> alter database open;

    Database altered.

    [From site:] The "manual startup" with RECOVER worked. I just needed to do a stop and restart to get the whole thing back to normal.

    • Article last edited: 10/8/2013