12
返回列表 发新帖
楼主: huanquan

rac down掉 谁帮我分析分析 AWR

[复制链接]
论坛徽章:
3
2010新春纪念徽章
日期:2010-03-01 11:19:50ITPUB9周年纪念徽章
日期:2010-10-08 09:32:25ITPUB十周年纪念徽章
日期:2011-11-01 16:20:28
11#
 楼主| 发表于 2010-7-9 09:47 | 只看该作者
请问上面我列出的心跳网络流量正常吗????

目前在测试过程中不定期的会有某一台机器会自动DOWN掉,过一段时间机器自动重启后自动恢复。
这是其中1台机器出错时候的日志
Thu Jul  8 20:00:24 2010
Thread 1 advanced to log sequence 3276 (LGWR switch)
  Current log# 9 seq# 3276 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Thu Jul  8 20:20:35 2010
Thread 1 advanced to log sequence 3277 (LGWR switch)
  Current log# 10 seq# 3277 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Thu Jul  8 20:41:42 2010
Thread 1 advanced to log sequence 3278 (LGWR switch)
  Current log# 2 seq# 3278 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
Thu Jul  8 21:02:42 2010
Thread 1 advanced to log sequence 3279 (LGWR switch)
  Current log# 1 seq# 3279 mem# 0: +DATAGROUP/oraykt/onlinelog/group_1.257.716687399
Thu Jul  8 21:23:57 2010
Thread 1 advanced to log sequence 3280 (LGWR switch)
  Current log# 9 seq# 3280 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Thu Jul  8 21:37:21 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_30844.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 21:37:22 2010
Trace dumping is performing id=[cdmp_20100708213722]
Thu Jul  8 21:46:31 2010
Thread 1 advanced to log sequence 3281 (LGWR switch)
  Current log# 10 seq# 3281 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Thu Jul  8 22:02:52 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_5052.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 22:02:52 2010
Trace dumping is performing id=[cdmp_20100708220252]
Thu Jul  8 22:03:10 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_6156.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 22:07:32 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_21294.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 22:07:33 2010
Trace dumping is performing id=[cdmp_20100708220733]
Thu Jul  8 22:07:46 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_21928.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 22:07:46 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_21926.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 22:08:42 2010
Thread 1 advanced to log sequence 3282 (LGWR switch)
  Current log# 2 seq# 3282 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
Thu Jul  8 22:17:26 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_20753.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Thu Jul  8 22:17:27 2010
Trace dumping is performing id=[cdmp_20100708221727]
Thu Jul  8 22:25:01 2010
ospid 7431: network interface with IP address 192.168.200.1 no longer running (check cable)
Thu Jul  8 22:30:09 2010
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.200.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 202.202.202.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.4.0.
System parameters with non-default values:
  processes                = 1000
  sessions                 = 1105
  __shared_pool_size       = 788529152
  __large_pool_size        = 16777216
  __java_pool_size         = 16777216
  __streams_pool_size      = 16777216
  spfile                   = +DATAGROUP/oraykt/spfileoraykt.ora
  sga_target               = 1610612736
  control_files            = +DATAGROUP/oraykt/controlfile/current.256.716687399
  db_block_size            = 8192
  __db_cache_size          = 754974720
  compatible               = 10.2.0.3.0
  log_archive_config       = dg_config=(oraykt,yktdg)
  log_archive_dest_1       = location=/ora/arch1
  log_archive_dest_2       = service=dbsub LGWR ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=yktdg
  log_archive_dest_state_2 = DEFER
  db_file_multiblock_read_count= 16
  cluster_database         = TRUE
  cluster_database_instances= 4
  db_create_file_dest      = +DATAGROUP
  thread                   = 1
  instance_number          = 1
  undo_management          = AUTO
  undo_tablespace          = UNDOTBS1
  remote_login_passwordfile= EXCLUSIVE
  db_domain                =
  remote_listener          =
  job_queue_processes      = 10
  background_dump_dest     = /ora/app/oracle/admin/oraykt/bdump
  user_dump_dest           = /ora/app/oracle/admin/oraykt/udump
  core_dump_dest           = /ora/app/oracle/admin/oraykt/cdump
  audit_file_dest          = /ora/app/oracle/admin/oraykt/adump
  db_name                  = oraykt
  open_cursors             = 300
  pga_aggregate_target     = 624951296
Cluster communication is configured to use the following interface(s) for this instance
  192.168.200.1
Thu Jul  8 22:30:09 2010
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=7535
DIAG started with pid=3, OS id=7537
PSP0 started with pid=4, OS id=7539
LMON started with pid=5, OS id=7541
LMD0 started with pid=6, OS id=7543
LMS0 started with pid=7, OS id=7545
LMS1 started with pid=8, OS id=7549
MMAN started with pid=9, OS id=7553
DBW0 started with pid=10, OS id=7555
LGWR started with pid=11, OS id=7557
CKPT started with pid=12, OS id=7564
SMON started with pid=13, OS id=7566
RECO started with pid=14, OS id=7568
CJQ0 started with pid=15, OS id=7570
MMON started with pid=16, OS id=7572
MMNL started with pid=17, OS id=7574
Thu Jul  8 22:30:10 2010
lmon registered with NM - instance id 1 (internal mem no 0)
Thu Jul  8 22:30:10 2010
Reconfiguration started (old inc 0, new inc 16)
List of nodes:
0 1 2 3
Global Resource Directory frozen
* allocate domain 0, invalid = TRUE
Communication channels reestablished
* domain 0 valid according to instance 1
* domain 0 valid = 1 according to instance 1
Thu Jul  8 22:30:10 2010
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Thu Jul  8 22:30:10 2010
LMS 0: 0 GCS shadows cancelled, 0 closed
Thu Jul  8 22:30:10 2010
LMS 1: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Thu Jul  8 22:30:10 2010
LMS 0: 0 GCS shadows traversed, 0 replayed
Thu Jul  8 22:30:10 2010
LMS 1: 0 GCS shadows traversed, 0 replayed
Thu Jul  8 22:30:10 2010
Submitted all GCS remote-cache requests
Post SMON to start 1st pass IR
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=18, OS id=7582
Thu Jul  8 22:30:11 2010
ALTER DATABASE   MOUNT
Thu Jul  8 22:30:11 2010
Starting background process ASMB
ASMB started with pid=20, OS id=7588
Starting background process RBAL
RBAL started with pid=21, OS id=7592
Thu Jul  8 22:30:14 2010
SUCCESS: diskgroup DATAGROUP was mounted
Thu Jul  8 22:30:19 2010
Setting recovery target incarnation to 1
Thu Jul  8 22:30:19 2010
Successful mount of redo thread 1, with mount id 4123355300
Thu Jul  8 22:30:19 2010
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE   MOUNT
Thu Jul  8 22:30:20 2010
ALTER DATABASE OPEN
Picked broadcast on commit scheme to generate SCNs
Thu Jul  8 22:30:25 2010
Sending CIC to internal enable redo thread
Thu Jul  8 22:30:25 2010
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=26, OS id=7778
Thu Jul  8 22:30:25 2010
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=27, OS id=7782
Thu Jul  8 22:30:26 2010
Thread 1 opened at log sequence 3284
  Current log# 9 seq# 3284 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Successful open of redo thread 1
Thu Jul  8 22:30:26 2010
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Thu Jul  8 22:30:26 2010
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Thu Jul  8 22:30:26 2010
ARC1: Becoming the heartbeat ARCH
Thu Jul  8 22:30:26 2010
SMON: enabling cache recovery
Thu Jul  8 22:30:35 2010
Successfully onlined Undo Tablespace 1.
Thu Jul  8 22:30:35 2010
SMON: enabling tx recovery
Thu Jul  8 22:30:35 2010
Database Characterset is ZHS16GBK
Opening with internal Resource Manager plan
where NUMA PG = 1, CPUs = 8
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=25, OS id=8937
Thu Jul  8 22:30:54 2010
Completed: ALTER DATABASE OPEN
Thu Jul  8 22:31:03 2010
ALTER SYSTEM SET service_names='SYS$SYS.KUPC$S_1_20100422110555.ORAYKT' SCOPE=MEMORY SID='oraykt1';
Thu Jul  8 22:40:58 2010
ALTER SYSTEM SET service_names='SYS$SYS.KUPC$S_1_20100422110555.ORAYKT','oraykt' SCOPE=MEMORY SID='oraykt1';
Thu Jul  8 22:55:02 2010
Thread 1 advanced to log sequence 3285 (LGWR switch)
  Current log# 10 seq# 3285 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Thu Jul  8 23:12:25 2010
Thread 1 advanced to log sequence 3286 (LGWR switch)
  Current log# 2 seq# 3286 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
Fri Jul  9 04:00:05 2010
ALTER SYSTEM ARCHIVE LOG
Fri Jul  9 04:00:06 2010
Thread 1 advanced to log sequence 3287 (LGWR switch)
  Current log# 1 seq# 3287 mem# 0: +DATAGROUP/oraykt/onlinelog/group_1.257.716687399
Fri Jul  9 04:35:46 2010
ALTER SYSTEM ARCHIVE LOG
Fri Jul  9 04:35:48 2010
Thread 1 advanced to log sequence 3288 (LGWR switch)
  Current log# 9 seq# 3288 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Fri Jul  9 08:46:59 2010
Thread 1 advanced to log sequence 3289 (LGWR switch)
  Current log# 10 seq# 3289 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Fri Jul  9 09:05:34 2010
Thread 1 advanced to log sequence 3290 (LGWR switch)
  Current log# 2 seq# 3290 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401

[ 本帖最后由 huanquan 于 2010-7-9 09:48 编辑 ]

使用道具 举报

回复

您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

TOP技术积分榜 社区积分榜 徽章 团队 统计 知识索引树 积分竞拍 文本模式 帮助
  ITPUB首页 | ITPUB论坛 | 数据库技术 | 企业信息化 | 开发技术 | 微软技术 | 软件工程与项目管理 | IBM技术园地 | 行业纵向讨论 | IT招聘 | IT文档
  ChinaUnix | ChinaUnix博客 | ChinaUnix论坛
CopyRight 1999-2011 itpub.net All Right Reserved. 北京盛拓优讯信息技术有限公司版权所有 联系我们 未成年人举报专区 
京ICP备16024965号-8  北京市公安局海淀分局网监中心备案编号:11010802021510 广播电视节目制作经营许可证:编号(京)字第1149号
  
快速回复 返回顶部 返回列表