|
请问上面我列出的心跳网络流量正常吗????
目前在测试过程中不定期的会有某一台机器会自动DOWN掉,过一段时间机器自动重启后自动恢复。
这是其中1台机器出错时候的日志
Thu Jul 8 20:00:24 2010
Thread 1 advanced to log sequence 3276 (LGWR switch)
Current log# 9 seq# 3276 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Thu Jul 8 20:20:35 2010
Thread 1 advanced to log sequence 3277 (LGWR switch)
Current log# 10 seq# 3277 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Thu Jul 8 20:41:42 2010
Thread 1 advanced to log sequence 3278 (LGWR switch)
Current log# 2 seq# 3278 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
Thu Jul 8 21:02:42 2010
Thread 1 advanced to log sequence 3279 (LGWR switch)
Current log# 1 seq# 3279 mem# 0: +DATAGROUP/oraykt/onlinelog/group_1.257.716687399
Thu Jul 8 21:23:57 2010
Thread 1 advanced to log sequence 3280 (LGWR switch)
Current log# 9 seq# 3280 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Thu Jul 8 21:37:21 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_30844.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 21:37:22 2010
Trace dumping is performing id=[cdmp_20100708213722]
Thu Jul 8 21:46:31 2010
Thread 1 advanced to log sequence 3281 (LGWR switch)
Current log# 10 seq# 3281 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Thu Jul 8 22:02:52 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_5052.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 22:02:52 2010
Trace dumping is performing id=[cdmp_20100708220252]
Thu Jul 8 22:03:10 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_6156.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 22:07:32 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_21294.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 22:07:33 2010
Trace dumping is performing id=[cdmp_20100708220733]
Thu Jul 8 22:07:46 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_21928.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 22:07:46 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_21926.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 22:08:42 2010
Thread 1 advanced to log sequence 3282 (LGWR switch)
Current log# 2 seq# 3282 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
Thu Jul 8 22:17:26 2010
Errors in file /ora/app/oracle/admin/oraykt/udump/oraykt1_ora_20753.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified. Did not receive valid message.
Thu Jul 8 22:17:27 2010
Trace dumping is performing id=[cdmp_20100708221727]
Thu Jul 8 22:25:01 2010
ospid 7431: network interface with IP address 192.168.200.1 no longer running (check cable)
Thu Jul 8 22:30:09 2010
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.200.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 202.202.202.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.4.0.
System parameters with non-default values:
processes = 1000
sessions = 1105
__shared_pool_size = 788529152
__large_pool_size = 16777216
__java_pool_size = 16777216
__streams_pool_size = 16777216
spfile = +DATAGROUP/oraykt/spfileoraykt.ora
sga_target = 1610612736
control_files = +DATAGROUP/oraykt/controlfile/current.256.716687399
db_block_size = 8192
__db_cache_size = 754974720
compatible = 10.2.0.3.0
log_archive_config = dg_config=(oraykt,yktdg)
log_archive_dest_1 = location=/ora/arch1
log_archive_dest_2 = service=dbsub LGWR ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=yktdg
log_archive_dest_state_2 = DEFER
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 4
db_create_file_dest = +DATAGROUP
thread = 1
instance_number = 1
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
remote_listener =
job_queue_processes = 10
background_dump_dest = /ora/app/oracle/admin/oraykt/bdump
user_dump_dest = /ora/app/oracle/admin/oraykt/udump
core_dump_dest = /ora/app/oracle/admin/oraykt/cdump
audit_file_dest = /ora/app/oracle/admin/oraykt/adump
db_name = oraykt
open_cursors = 300
pga_aggregate_target = 624951296
Cluster communication is configured to use the following interface(s) for this instance
192.168.200.1
Thu Jul 8 22:30:09 2010
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=7535
DIAG started with pid=3, OS id=7537
PSP0 started with pid=4, OS id=7539
LMON started with pid=5, OS id=7541
LMD0 started with pid=6, OS id=7543
LMS0 started with pid=7, OS id=7545
LMS1 started with pid=8, OS id=7549
MMAN started with pid=9, OS id=7553
DBW0 started with pid=10, OS id=7555
LGWR started with pid=11, OS id=7557
CKPT started with pid=12, OS id=7564
SMON started with pid=13, OS id=7566
RECO started with pid=14, OS id=7568
CJQ0 started with pid=15, OS id=7570
MMON started with pid=16, OS id=7572
MMNL started with pid=17, OS id=7574
Thu Jul 8 22:30:10 2010
lmon registered with NM - instance id 1 (internal mem no 0)
Thu Jul 8 22:30:10 2010
Reconfiguration started (old inc 0, new inc 16)
List of nodes:
0 1 2 3
Global Resource Directory frozen
* allocate domain 0, invalid = TRUE
Communication channels reestablished
* domain 0 valid according to instance 1
* domain 0 valid = 1 according to instance 1
Thu Jul 8 22:30:10 2010
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Thu Jul 8 22:30:10 2010
LMS 0: 0 GCS shadows cancelled, 0 closed
Thu Jul 8 22:30:10 2010
LMS 1: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Thu Jul 8 22:30:10 2010
LMS 0: 0 GCS shadows traversed, 0 replayed
Thu Jul 8 22:30:10 2010
LMS 1: 0 GCS shadows traversed, 0 replayed
Thu Jul 8 22:30:10 2010
Submitted all GCS remote-cache requests
Post SMON to start 1st pass IR
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=18, OS id=7582
Thu Jul 8 22:30:11 2010
ALTER DATABASE MOUNT
Thu Jul 8 22:30:11 2010
Starting background process ASMB
ASMB started with pid=20, OS id=7588
Starting background process RBAL
RBAL started with pid=21, OS id=7592
Thu Jul 8 22:30:14 2010
SUCCESS: diskgroup DATAGROUP was mounted
Thu Jul 8 22:30:19 2010
Setting recovery target incarnation to 1
Thu Jul 8 22:30:19 2010
Successful mount of redo thread 1, with mount id 4123355300
Thu Jul 8 22:30:19 2010
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE MOUNT
Thu Jul 8 22:30:20 2010
ALTER DATABASE OPEN
Picked broadcast on commit scheme to generate SCNs
Thu Jul 8 22:30:25 2010
Sending CIC to internal enable redo thread
Thu Jul 8 22:30:25 2010
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=26, OS id=7778
Thu Jul 8 22:30:25 2010
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=27, OS id=7782
Thu Jul 8 22:30:26 2010
Thread 1 opened at log sequence 3284
Current log# 9 seq# 3284 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Successful open of redo thread 1
Thu Jul 8 22:30:26 2010
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Thu Jul 8 22:30:26 2010
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Thu Jul 8 22:30:26 2010
ARC1: Becoming the heartbeat ARCH
Thu Jul 8 22:30:26 2010
SMON: enabling cache recovery
Thu Jul 8 22:30:35 2010
Successfully onlined Undo Tablespace 1.
Thu Jul 8 22:30:35 2010
SMON: enabling tx recovery
Thu Jul 8 22:30:35 2010
Database Characterset is ZHS16GBK
Opening with internal Resource Manager plan
where NUMA PG = 1, CPUs = 8
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=25, OS id=8937
Thu Jul 8 22:30:54 2010
Completed: ALTER DATABASE OPEN
Thu Jul 8 22:31:03 2010
ALTER SYSTEM SET service_names='SYS$SYS.KUPC$S_1_20100422110555.ORAYKT' SCOPE=MEMORY SID='oraykt1';
Thu Jul 8 22:40:58 2010
ALTER SYSTEM SET service_names='SYS$SYS.KUPC$S_1_20100422110555.ORAYKT','oraykt' SCOPE=MEMORY SID='oraykt1';
Thu Jul 8 22:55:02 2010
Thread 1 advanced to log sequence 3285 (LGWR switch)
Current log# 10 seq# 3285 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Thu Jul 8 23:12:25 2010
Thread 1 advanced to log sequence 3286 (LGWR switch)
Current log# 2 seq# 3286 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
Fri Jul 9 04:00:05 2010
ALTER SYSTEM ARCHIVE LOG
Fri Jul 9 04:00:06 2010
Thread 1 advanced to log sequence 3287 (LGWR switch)
Current log# 1 seq# 3287 mem# 0: +DATAGROUP/oraykt/onlinelog/group_1.257.716687399
Fri Jul 9 04:35:46 2010
ALTER SYSTEM ARCHIVE LOG
Fri Jul 9 04:35:48 2010
Thread 1 advanced to log sequence 3288 (LGWR switch)
Current log# 9 seq# 3288 mem# 0: +DATAGROUP/oraykt/onlinelog/group_9.291.716828587
Fri Jul 9 08:46:59 2010
Thread 1 advanced to log sequence 3289 (LGWR switch)
Current log# 10 seq# 3289 mem# 0: +DATAGROUP/oraykt/onlinelog/group_10.292.716828931
Fri Jul 9 09:05:34 2010
Thread 1 advanced to log sequence 3290 (LGWR switch)
Current log# 2 seq# 3290 mem# 0: +DATAGROUP/oraykt/onlinelog/group_2.258.716687401
[ 本帖最后由 huanquan 于 2010-7-9 09:48 编辑 ] |
|