ANBOB™

本地文件系统使用率告警，分析发现audit目录下不断的生成trace文件，该目录记录的是sys登录，目前以每秒800-900KB的速度生成写日志属于一种不正常现象，先增加crontab 周期清空日志，是当前版本的一个rman相关的bug, 下面记录这个bug. 版本11.2.0.3 RAC on AIX.

root@anbob1:/oracle/app/oracle/product/11.2.0.3/dbhome_1/rdbms/audit>while sleep 1; do du -sk . ; done;
87368   .
88180   .
89044   .
89956   .
90824   .
91496   .
92248   .
93096   .
93884   .
94680   .
95412   .
96280   .
97032   .

root@anbob1:/oracle/app/oracle/product/11.2.0.3/dbhome_1/rdbms/audit>ls -l
total 21104
-rw-r-----    1 oracle   oinstall   10240174 Sep 18 09:30 orcl1_ora_43713172_13cb.aud
-rw-r-----    1 oracle   oinstall     556702 Sep 18 09:30 orcl1_ora_43713172_13cc.aud

root@anbob1:/oracle/app/oracle/product/11.2.0.3/dbhome_1/rdbms/audit>more orcl1_ora_43713172_13cb.aud
Audit file /oracle/app/oracle/product/11.2.0.3/dbhome_1/rdbms/audit/orcl1_ora_43713172_13cb.aud
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
ORACLE_HOME = /oracle/app/oracle/product/11.2.0.3/dbhome_1
System name:    AIX
Node name:      anbob1
Release:        1
Version:        7
Machine:        00F80C614C00
Instance name: orcl1
Redo thread mounted by this instance: 1
Oracle process number: 771
Unix process pid: 43713172, image: oracle@anbob1 (TNS V1-V3)

Fri Sep 18 09:30:12 2020 +08:00
LENGTH : '361'
ACTION :[211] 'begin sys.dbms_backup_restore.createRmanOutputRow( l0row_id    => :l0row_id, l0row_stamp => :l0row_stamp, row_id      => :row_id, row_stamp   => :row_stamp, txt         => :txt, samelin
e    => :i_sameline); end;'
DATABASE USER:[1] '/'
PRIVILEGE :[6] 'SYSDBA'
CLIENT USER:[6] 'oracle'
CLIENT TERMINAL:[0] ''
STATUS:[1] '0'
DBID:[10] '3519797422'

Fri Sep 18 09:30:12 2020 +08:00
LENGTH : '361'
ACTION :[211] 'begin sys.dbms_backup_restore.createRmanOutputRow( l0row_id    => :l0row_id, l0row_stamp => :l0row_stamp, row_id      => :row_id, row_stamp   => :row_stamp, txt         => :txt, samelin
e    => :i_sameline); end;'
DATABASE USER:[1] '/'
PRIVILEGE :[6] 'SYSDBA'
CLIENT USER:[6] 'oracle'
CLIENT TERMINAL:[0] ''
STATUS:[1] '0'
DBID:[10] '3519797422'

是备份相关的任务，查看RMAN进程

anbob1:/home/oracle> ps -ef|grep rman
  oracle 42008748 63176732   0 09:31:27  pts/6  0:00 grep rman
  oracle 11667762 46139160  21 15:31:20      - 144:00 rman target sys/manager rcvcat rman/rman@veritas msglog /usr/openv/netbackup/ext/db_ext/scripts/oracle_arch.sh.out append
anbob1:/home/oracle> tail -f /usr/openv/netbackup/ext/db_ext/scripts/oracle_arch.sh.out
RMAN-00558: error encountered while parsing input commands
RMAN-01006: error signaled during parse
RMAN-02005: token too big

RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-00558: error encountered while parsing input commands
RMAN-01006: error signaled during parse
RMAN-02005: token too big


RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-00558: error encountered while parsing input commands
RMAN-01006: error signaled during parse
RMAN-02005: token too big
...

属于Bug 12861117 RMAN session spins, 在11.2.0.4和12.1修复。因为磁盘空间满或rman input error导致rman session进入无限spin, KILL 进程临时解决。

root@anbob1:/oracle/app/oracle/product/11.2.0.3/dbhome_1/rdbms/audit>ps -ef|grep rman
    root 65275488 25692658   0 09:48:54  pts/6  0:00 grep rman
  oracle 11667762 46139160  17 15:31:20      - 146:27 rman target sys/manager rcvcat rman/rman@veritas msglog /usr/openv/netbackup/ext/db_ext/scripts/oracle_arch.sh.out append

root@anbob1:/oracle/app/oracle/product/11.2.0.3/dbhome_1/rdbms/audit>kill -9 11667762

打赏

微信扫一扫，打赏作者吧～