Skip to main content

Satellite UNDO_TBS is full

[root@pdgllprhnsat01 rhnsat]# spacewalk-remove-channel -c rhel-i386-server-5 -c dell-om-platform_independent-rhel-i386-server-5 -c rhel-i386-server-productivity-5 -c rhn-tools-rhel-i386-server-5
Deleting package metadata (9499):
                  ________________________________________
Removing:        
ERROR: unhandled exception occurred: ((30036, "ORA-30036: unable to extend segment by 8 in undo tablespace 'UNDO_TBS'\n", 'delete from rhnChannelPackage where package_id = :package_id')).
Traceback (most recent call last):
  File "/usr/bin/spacewalk-remove-channel", line 560, in ?
    sys.exit(main() or 0)
  File "/usr/bin/spacewalk-remove-channel", line 147, in main
    skip_channels=options.skip_channels)
  File "/usr/bin/spacewalk-remove-channel", line 305, in delete_channels
    _delete_rpms(rpms_ids)
  File "/usr/bin/spacewalk-remove-channel", line 477, in _delete_rpms
    _delete_rpm_group(toDel[:group])
  File "/usr/bin/spacewalk-remove-channel", line 503, in _delete_rpm_group
    count = h.executemany(package_id=packageIds)
  File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/sql_base.py", line 172, in executemany
    return apply(self._execute_wrapper, (self._executemany, ) + p, kw)
  File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/driver_cx_Oracle.py", line 108, in _execute_wrapper
    retval = apply(function, p, kw)
  File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/driver_cx_Oracle.py", line 208, in _executemany
    self._real_cursor.executemany(None, arr)
SQLError: (30036, "ORA-30036: unable to extend segment by 8 in undo tablespace 'UNDO_TBS'\n", 'delete from rhnChannelPackage where package_id = :package_id')
[root@pdgllprhnsat01 rhnsat]# df -h /rhnsat
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol01
                      265G  101G  151G  41% /
[root@pdgllprhnsat01 rhnsat]# su - oracle
-bash-3.2$ db-control report
Tablespace                  Size    Used   Avail   Use%
DATA_TBS                   31.7G   21.1G   10.6G    67%
SYSAUX                      500M  241.9M    258M    48%
SYSTEM                      400M  271.4M  128.5M    68%
TEMP_TBS                    1.9G      0B    1.9G     0%
UNDO_TBS                    3.9G    3.9G      0B   100%
USERS                       128M     64K  127.9M     0%
-bash-3.2$ db-control extend UNDO_TBS
Extending UNDO_TBS... done.
-bash-3.2$ db-control report
Tablespace                  Size    Used   Avail   Use%
DATA_TBS                   31.7G   21.1G   10.6G    67%
SYSAUX                      500M  241.9M    258M    48%
SYSTEM                      400M  271.4M  128.5M    68%
TEMP_TBS                    1.9G      0B    1.9G     0%
UNDO_TBS                    4.3G    3.9G  499.8M    89%
USERS                       128M     64K  127.9M     0%
-bash-3.2$ db-control extend UNDO_TBS
Extending UNDO_TBS... done.
-bash-3.2$ db-control report
Tablespace                  Size    Used   Avail   Use%
DATA_TBS                   31.7G   21.1G   10.6G    67%
SYSAUX                      500M  241.9M    258M    48%
SYSTEM                      400M  271.4M  128.5M    68%
TEMP_TBS                    1.9G      0B    1.9G     0%
UNDO_TBS                    4.8G    3.9G  999.8M    80%
USERS                       128M     64K  127.9M     0%

Comments

Post a Comment

Popular posts from this blog

P2V using dd for KVM-QEMU guest

Preface: I have certainly not exhaustively tested this process.  I had a specific need and found a specific solution that worked. Situation:  I was issued a shiny new laptop running Red Hat Enterprise Linux 7 (with Corp VPN, certs, Authentication configuration, etc...)  The image was great, but I needed more flexibility on my bare metal.  So, my goal was to P2V the corporate image so I could just run it as a VM. * Remove corporate drive and install new SSD * install corp drive in external USB-3 case * Install RHEL 7 on new SSD * dd old drive to a disk-image file in a temp location which will be an image which is the same size as your actual drive (unless you have enough space in your destination to contain a temp and converted image) * convert the raw disk-image to a qcow file while pushing it to the final location - this step should reduce the disk size - however, I believe it will only reduce/collapse zero-byte blocks (not just free space - i.e. if you de...
1 comment
Read more

Extending SNMP to run arbitrary shell script

Why are we here... This is not likely something I would have pursued under normal circumstances.  I happen to be working for a customer/client who is not afforded a lot of flexibility to accomplish their goals.  In this case, the rigor is justified.  They have to sometimes be fairly creative with how they solve problems. In this case they would like to utilize an existing snmp implementation to execute a command (or shell script) on a remote system.  They came to me with the idea of using Net-SNMP extend. https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Deployment_Guide/sect-System_Monitoring_Tools-Net-SNMP-Extending.html NOTE:  This is NOT a good implementation strategy in the "real world"  it will simply allow you to test the functionality.  There are a TON of security implications which would need to be taken in to consideration. Implementation Steps: [root@rh7tst01 ~]# yum -y install net-snmp net-snmp-utils ...
Post a Comment
Read more

RHN Satellite Server (spacewalk) repomd.xml not found

"repomd.xml not found" If you add a channel, or if your RHN cache gets corrupted, and one of your guests complains that it cannot find repomd.xml for jb-ews-2-x86_64-server-5-rpm (for example) - you need to rebuild your repodata cache. Normally this is an automated job - which is exemplified by the fact that you have obviously built out your entire Satellite environment and never had to do any of the steps you are about to do. So - some prep work: Open 3 terminals to your Satellite Server and run: # Term 1 cd /var/cache/rhn watch "ls -l | wc -l" # Term 2 pwd cd /var/log/rhn tail -f rhn_taskomatic_daemon.log # Term 3 satellite-sync --channel=jb-ews-2-x86_64-server-5-rpm Once the satellite-sync has completed, you >should< see the count increment by one.  If you are unlucky (like me) you will not. You then need to login to the Satellite WebUI as the satellite admin user. Click on the Admin tab (at the top) Task Schedules (on the left) fin...
Post a Comment
Read more