Transcription

Oracle Exadata Database MachineSystem OverviewRelease 21.2F29255-14February 2022

Oracle Exadata Database Machine System Overview, Release 21.2F29255-14Copyright 2008, 2022, Oracle and/or its affiliates.Primary Author: Peter FusekContributing Authors: James SpillerContributors: Doug Archambault, Leo Agranonik, Andrew Babb, Nilesh Choudhury, Henry Chow, RavindraDani, Boris Erlikhman, Jaime Figueroa, Roger Hansen, Leslie Keller, Frank Kobylanski, René Kundersma,Sue Lee, Jennifer Leung, Yang Liu, Juan Loaiza, Barb Lundhild, Catherine Luu, Philip Newlan, Dan Norris,Michael Nowak, Bharat Paliwal, Hector Pujol, Dmitry Potapov, Darryl Presley, Ashish Ray, Richard Scales,Oliver Sharwood, Jia Shi, Kesavan Srinivasan, Mahesh Subramaniam, Krishnadev Telikicherla, Cliff Thomas,Alex Tsukerman, Shreyas Udgaonkar, Kothanda Umamageswaran, Doug Utzig, James Viscusi, VernWagman, Zheren Zhang, Alex BlythThis software and related documentation are provided under a license agreement containing restrictions onuse and disclosure and are protected by intellectual property laws. Except as expressly permitted in yourlicense agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverseengineering, disassembly, or decompilation of this software, unless required by law for interoperability, isprohibited.The information contained herein is subject to change without notice and is not warranted to be error-free. Ifyou find any errors, please report them to us in writing.If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it onbehalf of the U.S. Government, then the following notice is applicable:U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software,any programs embedded, installed or activated on delivered hardware, and modifications of such programs)and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government endusers are "commercial computer software" or "commercial computer software documentation" pursuant to theapplicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use,reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/oradaptation of i) Oracle programs (including any operating system, integrated software, any programsembedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oraclecomputer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in thelicense contained in the applicable contract. The terms governing the U.S. Government’s use of Oracle cloudservices are defined by the applicable contract for such services. No other rights are granted to the U.S.Government.This software or hardware is developed for general use in a variety of information management applications.It is not developed or intended for use in any inherently dangerous applications, including applications thatmay create a risk of personal injury. If you use this software or hardware in dangerous applications, then youshall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure itssafe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of thissoftware or hardware in dangerous applications.Oracle, Java, and MySQL are registered trademarks of Oracle and/or its affiliates. Other names may betrademarks of their respective owners.Intel and Intel Inside are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks areused under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Epyc,and the AMD logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registeredtrademark of The Open Group.This software or hardware and documentation may provide access to or information about content, products,and services from third parties. Oracle Corporation and its affiliates are not responsible for and expresslydisclaim all warranties of any kind with respect to third-party content, products, and services unless otherwiseset forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not beresponsible for any loss, costs, or damages incurred due to your access to or use of third-party content,products, or services, except as set forth in an applicable agreement between you and Oracle.

ContentsPreface1AudiencexvDocumentation AccessibilityxvDiversity and InclusionxvConventionsxvIntroduction to Oracle Exadata Database Machine and Oracle ExadataStorage Expansion Rack1.1Exadata Database Machine Architecture1-11.2Exadata Database Machine Configurations1-21.2.11-31.3Oracle Exadata Database Machine Performance Features1-31.4Oracle Exadata Rack Limits and Restrictions1-41.4.1Restrictions for Modifying Oracle Exadata Rack Hardware1-41.4.2Restrictions for Modifying the Exadata Database Machine SoftwareComponents1-5Restrictions for Connecting Exadata Database Machine with Other Hardware,Systems, or Networks1-6Maximum Number of Database Processes1-71.4.31.4.4Part I2Elastic ConfigurationWhat's New in Oracle Exadata Database MachineNew Features for Oracle Exadata System Software Release 21.x2.1What's New in Oracle Exadata Database Machine 21.2.02-12.1.1Exadata Database Machine X9M Support2-12.1.2Persistent Storage Index2-22.1.3Persistent Columnar Cache2-22.1.4IORM Cluster Plan2-32.1.5Smart Scan Metadata Sharing2-32.1.6Oracle ASR Support for Cisco RoCE Network Fabric Switches andManagement Network Switch2-4iii

3Patch Manager Support for the Management Network Switch2-42.1.8Options to Preserve Redundancy while Dropping a Physical Disk2-42.1.9Faster Upgrades with ILOM Pre-Staging2-52.1.10Faster Recovery from Flash Cache Failure2-52.1.11Automatic Recovery from Disk Controller Cache Failure2-52.1.12Enhanced Database Server Alerting2-62.1.13Oracle ACFS I/O Caching in Flash Cache2-62.1.14Smart Scan Fast Decryption2-6New Features for Oracle Exadata System Software Release 20.x3.142.1.7What's New in Oracle Exadata Database Machine 20.1.03-13.1.1Exadata Secure RDMA Fabric Isolation3-13.1.2Smart Flash Log Write-Back3-23.1.3Fast In-Memory Columnar Cache Creation3-33.1.4Cell-to-Cell Rebalance Preserves PMEM Cache Population3-33.1.5Control Persistent Memory Usage for Specific Databases3-33.1.6Application Server Update for Management Server3-4New Features for Oracle Exadata System Software Release 19.x4.1What's New in Oracle Exadata Database Machine 19.3.04.1.1Persistent Memory Data Accelerator4-14.1.2Persistent Memory Commit Accelerator4-24.1.3Support for Oracle Exadata X8M Systems4-24.1.4Instant Failure Detection for X8M Systems4-34.1.5KVM for Virtual Environments4-34.1.6Faster Encrypted Table Smart Scans4-34.1.7Smart Aggregation4-44.1.8Smart In-Memory Columnar Cache with Row IDs4-44.1.9Smart In-memory Columnar Cache with Chained Rows4-54.1.10Fast Smart In-memory Columnar Cache Creation4-54.1.11Encryption of System Logs to Remote Destinations4-54.1.12Update a Single SNMP User Definition4-64.1.13Securing Storage Server Software Processes with Memory Protection Keys4-64.1.14Default XFS File System for X8M Servers4-64.1.15Oracle Linux Kernel to Unbreakable Enterprise Kernel 5 and Oracle LinuxDistribution Upgraded to Oracle Linux 7.74-6Software Certification Ends for Exadata Database Machine X2 Servers4-74.1.164.24-1What's New in Oracle Exadata Database Machine 19.2.04-74.2.1Support for New Hardware - X8 Servers4-74.2.2Exadata Extended (XT) Storage Server4-8iv

4.2.34.3What's New in Oracle Exadata Database Machine 19.1.04-84-84.3.1Oracle Linux Upgraded to Oracle Linux 7.54.3.2Automated Cloud Scale Performance Monitoring4-104.3.3Faster Smart Scans Using Column-level Checksum4-104.3.4Enhanced OLTP High Availability During Cell Outages and Flash Failures4-114.3.5Support for Host and ILOM on Separate Network4-124.3.6DB UNIQUE NAME Support for Multiple Clusters Sharing Exadata Storage4-124.3.7Secure Eraser Updates4-134-94.3.7.1Automatic Upgrading of Multi-pass Disk Erasure to Secure Eraser4-134.3.7.2Automatic Secure Eraser as Part of Imaging4-144.3.7.3Secure Eraser Improvements and New Features4-144.3.8Server Time Synchronization Uses Chrony4-144.3.9Quorum Disk Manager Service Change4-154.3.10Audit Rules File4-154.3.11Customizable SYSLOG Format4-154.3.12USE LARGE PAGES Default Value Set To AUTO ONLY4-164.3.13Security Improvements4-164.3.13.1Access Control for RESTful Service4-164.3.13.2Password Expiration for Remote Users4-174.3.13.3Advanced Intrusion Detection Environment (AIDE)4-174.3.13.4Implementing the Principle of Least Privilege to Improve Security4-184.3.13.5Increased Security for Storage Server Processes4-184.3.13.6SSHD ClientAliveInterval Changed to 600 Seconds4-194.3.13.7Stronger Password Requirements4-194.3.13.8Upload DIAGPACK to Oracle ASR Manager using HTTPs4-204.3.14Deprecated Features in Oracle Exadata System Software Release 19.1.04-204.3.14.1Deprecation of Interleaved Grid Disks4-204.3.14.2Deprecation of nfsimg Images4-204.3.155Changes to IORM flashcachesize Attribute and Hard Disk I/O LimitsDesupported Features in Oracle Exadata System Software Release 19.1.04-20New Features for Oracle Exadata System Software Release 185.1What's New in Oracle Exadata Database Machine 18c (18.1.0)5-15.1.1In-Memory OLTP and Consolidation Acceleration5-15.1.2In-Memory Columnar Caching on Storage Servers5-25.1.3Oracle Exadata Storage Server Cloud Scale Software Update5-35.1.4Faster Oracle Exadata Database Server Software Update5-45.1.5Improved Ethernet Performance in Oracle VM5-45.1.6Performance Improvement Following Disk Online Completion5-45.1.7Improved High Availability After Flash Failures5-4v

5.265.1.8IORM Maximum Utilization Limit Applies to Flash Devices5-55.1.9OEDA Command Line Interface5-5Oracle Exadata Database Machine X7 New Features5-65.2.1Do Not Service LED on Storage Servers5-65.2.2Online Flash Disk Replacement for Oracle Exadata Storage Server X75-65.2.3New Configuration for System Partitions on Storage Servers5-75.2.4Secure Boot5-8New Features for Oracle Exadata System Software Release 12.x6.1What's New in Oracle Exadata Database Machine 12.2.1.1.06-16.1.1In-Memory Columnar Caching on Storage Servers6-26.1.2Columnar Flash Cache for Encrypted Tablespace6-36.1.3Set Membership in Storage Indexes6-36.1.4Storage Index to Store Column Information for More Than Eight Columns6-36.1.55x Faster Oracle Exadata System Software Updates6-46.1.6Faster Performance for Large Analytic Queries and Large Loads6-46.1.7Secure Eraser6-56.1.8Cell-to-Cell Offload Support for ASM-Scoped Security6-56.1.9Adding an Additional Network Card to Oracle Exadata Database Machine X6-2Database Servers6-56.1.10Automatic Diagpack Upload for Oracle ASR6-66.1.11CREATE DIAGPACK and LIST DIAGPACK Commands Available for OracleExadata Database Servers6-76.1.12Rescue Plan6-76.1.13Support for IPv6 Oracle VM and Tagged VLANs6-86.1.14Management Server Can Remain Online During NTP, DNS, and ILOMChanges6-86.1.15New Charts in ExaWatcher6-86.1.16New Metrics for Redo Log Writes6-86.1.17Quarantine Manager Support for Cell-to-Cell Rebalance and High ThroughputWrite Operations6-96.1.18ExaCLI and REST API Enabled for Management Server6-96.1.19New Features in Oracle Grid Infrastructure 12.2.1.1.06-96.1.19.1Oracle ASM Flex Disk Groups6-106.1.19.2Oracle Flex ASM6-106.1.19.3Faster Redundancy Restoration After Storage Loss6-106.1.19.4Dynamic Power Change6-116.1.19.5Quorum Disk Support in Oracle Universal Installer6-116.1.20New Features in Oracle Database 12c Release 2 (12.2.0.1)6-126.1.20.1Database Server I/O Latency Capping6-126.1.20.2Exadata Smart Scan Offload for Compressed Index Scan6-12vi

6.1.20.3Exadata Smart Scan Offload Enhancements for In-Memory Aggregation(IMA)6-126.1.20.4Exadata Smart Scan Offload Enhancements for XML6-136.1.20.5Exadata Smart Scan Offload Enhancements for LOBs6-136.1.20.6New Features in Oracle Exadata Snapshots6-136.1.216.26.36.4Oracle Linux Kernel Upgraded to Unbreakable Enterprise Kernel 4 andOracle VM Upgraded to 3.4.26-14What's New in Oracle Exadata Database Machine 12c Release 1 (12.1.2.3.0)6-146.2.1Performance Improvement for Oracle Exadata System Software Updates6-156.2.2Quorum Disk Manager Utility6-156.2.3VLAN Support6-156.2.4Adaptive Scrubbing Schedule6-166.2.5IPv6 Support in ASR Manager6-176.2.6Increased Maximum Number of Database Processes6-176.2.7Cell-to-Cell Rebalance Preserves Storage Index6-196.2.8ASM Disk Size Checked When Reducing Grid Disk Size6-196.2.9Support for Alerts in CREATE DIAGPACK6-20What's New in Oracle Exadata Database Machine 12c Release 1 (12.1.2.2.0)6.3.1Smart Fusion Block Transfer6-206.3.28 TB Hard Disk Support6-216.3.3IPv6 Support6-216.3.4Running CellCLI Commands from Compute Nodes6-236.3.5Disabling SSH on Storage Servers6-246.3.6Fixed Allocations for Databases in the Flash Cache6-246.3.7Oracle Exadata Storage Statistics in AWR Reports6-246.3.8Increased Maximum Number of Database Processes6-256.3.9Custom Diagnostic Package for Storage Server Alerts6-266.3.10Updating Nodes Using patchmgr6-266.3.11kdump Operational for 8-Socket Database Nodes6-266.3.12Redundancy Check When Powering Down the Storage Server6-276.3.13Specifying an IP Address for SNMP Traps6-276.3.14Reverse Offload Improvements6-276.3.15Cell-to-Cell Rebalance Preserves Flash Cache Population6-28What's New in Oracle Exadata Database Machine 12c Release 1 (12.1.2.1.2)6.4.16.56-20InfiniBand Partitioning for Virtualized Exadata EnvironmentsWhat's New in Oracle Exadata Database Machine 12c Release 1 (12.1.2.1.1)6-286-286-286.5.1Flash Performance Improvement in X5 Storage Servers6-296.5.2Oracle Exadata Virtual Machines6-296.5.3Infrastructure as a Service (IaaS) with Capacity-on-Demand (CoD)6-296.5.4Improved Flash Cache Metrics6-296.5.5Leap Second Time Adjustment6-296.5.6Network Resource Management6-29vii

6.5.76.6Oracle Exadata Database Machine Elastic Configurations6-316.6.2Sparse Grid Disks6-316.6.3Snapshot Databases for Test and Development6-316.6.4Columnar Flash Caching6-326.6.5Oracle Exadata System Software I/O Latency Capping for Write Operations6-336.6.6Elimination of False Drive Failures6-346.6.7Flash and Disk Life Cycle Management Alert6-346.6.8Performance Optimization for SQL Queries with Minimum or MaximumFunctions6-34Oracle Exadata Storage Server Software Performance Statistics in AWRReports6-356.6.10Exafusion Direct-to-Wire Protocol6-356.6.11Management Server on Database Servers6-356.6.12SQL Operators for JSON and XML6-366.6.13I/O Resource Management for Flash6-366.6.14Flash Cache Space Resource Management6-376.6.15I/O Resource Management Profiles6-376.6.16Write Back Flash Cache on Extreme Flash Cells6-376.6.17Secure Erase for 1.6 TB Flash Drives in Extreme Flash and High CapacitySystems6-386.6.18Increased Exadata Cell Connection Limit6-386.6.19Support for SNMP v36-386.6.20Federal Information Processing Standards (FIPS) 140-2 Compliant SmartScan6-39Oracle Exadata Virtual Machines6-40What's New in Oracle Exadata Database Machine 12c Release 1 (12.1.1.1.1)6.7.16-40Additional SQL Operators and Conditions for LOB and CLOB6-41What's New in Oracle Exadata Database Machine 12c Release 1 (12.1.1.1.0)6.8.176-306.6.16.6.216.86-30What's New in Oracle Exadata Database Machine 12c Release 1 (12.1.2.1.0)6.6.96.7DBMCLI Replaces /opt/oracle.cellos/compmon/exadata mon hw asr.pl Script6-41Support for Oracle Database Releases 12c Release 1 (12.1) and 11g Release2 (11.2)6-416.8.2IORM Support for CDBs and PDBs6-426.8.3Cell to Cell Data Transfer6-436.8.4Desupport of HP Oracle Database Machine Hardware6-43New Features for Oracle Exadata System Software Release 11.x7.1What's New in Oracle Exadata Database Machine 11g Release 2 (11.2.3.3.1)7-17.1.1Oracle Capacity-on-Demand for Database Servers7-17.1.2Exadata I/O Latency Capping7-27.1.3Oracle Exadata Storage Server I/O Timeout Threshold7-27.1.4Support for New Hardware7-3viii

7.27.3What's New in Oracle Exadata Database Machine 11g Release 2 (11.2.3.3.0)7.2.1Flash Cache Compression7-37.2.2Automatic Flash Caching for Table Scan Workloads7-47.2.3Fast Data File Creation7-47.2.4Network Resource Management7-57.2.5Active Bonding Network7-57.2.6Oracle ASM Disk Group in Appliance Mode7-67.2.7Automatic Hard Disk Scrub and Repair7-67.2.8Drop Hard Disk for Replacement7-77.2.9Drop BBU for Replacement7-77.2.10Oracle Exadata Database Machine Eighth Rack Configuration7-87.2.11Cell Alert Summary7-87.2.12Secure Erase for Larger Drives7-97.2.13Periodic ILOM Reset7-97.2.14Oracle Exawatcher Replaces Oracle OSwatcher7-97.2.15Enhancements for Hardware and Software7-9What's New in Oracle Exadata Database Machine 11g Release 2 (11.2.3.2)7.3.1Write-Back Flash Cache with Exadata Smart Flash Cache7.3.1.17.47.57.7Exadata Smart Flash Cache Persistent After Cell Restart7-107-117-117.3.2Graceful Shutdown of CELLSRV Services7-117.3.3LED Notification for Storage Server Disk Removal7-117.3.4Identification of Underperforming Disks7-117.3.5Oracle Database File System Support for Oracle Solaris7-127.3.6Health Factor for Predictive Failed Disk Drop7-127.3.7Hard Disk Drive Numbering in Servers7-12What's New in Oracle Exadata Database Machine 11g Release 2 (11.2.3.1)7-137.4.1Support for Oracle Solaris 11 (SRU2a)7-147.4.2Linux Database Server Updates with Unbreakable Linux Network7-147.4.3Oracle Enterprise Manager Cloud Control for Oracle Exadata DatabaseMachine7-147.4.4I/O Resource Management Support for More Than 32 Databases7-147.4.5Oracle Database 11g Release 2 (11.2.0.3)7-147.4.6Exadata Cell Connection Limit7-15What's New in Oracle Exadata Database Machine 11g Release 2 (11.2.2.4)7.5.17.67-3Oracle Exadata Smart Flash LogWhat's New in Oracle Exadata Database Machine 11g Release 2 (11.2.2.3)7-157-157-157.6.1Oracle Solaris Operating System for Database Servers7-167.6.2Exadata Secure Erase7-167.6.3Optimized Smart Scan7-16What's New in Oracle Exadata Database Machine 11g Release 2 (11.2.1.2)7.7.1Exadata Smart Flash Cache7-177-17ix

7.87.7.2Hybrid Columnar Compression7-187.7.3Storage Index7-197.7.4Smart Scan of Encrypted Data7-197.7.5Interleaved Grid Disks7-197.7.6Data Mining Scoring Offload7-207.7.7Enhanced Manageability Features7-20What's New in Oracle Exadata Database Machine 11g Release 2 (11.2)7.8.1Part II87-20Expanded Content in the Guide7-21Hardware ComponentsHardware Components of Exadata Database Machine8.1Exadata Database Machine Hardware Components by Model8.2Oracle Exadata Database Server Hardware Components8.38-18-258.2.1Database Server Components of Exadata Database Machine X9M-28-268.2.2Database Server Components of Exadata Database Machine X9M-88-268.2.3Database Server Components of Exadata Database Machine X8M-28-278.2.4Database Server Components of Exadata Database Machine X8M-88-278.2.5Database Server Components of Oracle Exadata Database Machine X8-28-288.2.6Database Server Components of Oracle Exadata Database Machine X8-88-288.2.7Database Server Components of Oracle Exadata Database Machine X7-28-298.2.8Database Server Components of Oracle Exadata Database Machine X7-88-298.2.9Database Server Components of Oracle Exadata Database Machine X6-28-298.2.10Database Server Components of Oracle Exadata Database Machine X5-28-308.2.11Database Server Components of Oracle Exadata Database Machine X5-8and X6-88-308.2.12Database Server Components of Oracle Exadata Database Machine X4-28-318.2.13Database Server Components of Oracle Exadata Database Machine X4-8Full Rack8-318.2.14Database Server Components of Oracle Exadata Database Machine X3-28-318.2.15Database Server Components of Oracle Exadata Database Machine X3-8Full Rack8-328.2.16Database Server Components of Oracle Exadata Database Machine X2-28-328.2.17Database Server Components of Oracle Exadata Database Machine X2-8Full Rack8-33Oracle Exadata Storage Server Hardware Components8-348.3.1Extreme Flash Exadata Storage Server X9M-2 Hardware Components8-358.3.2High Capacity Exadata Storage Server X9M-2 Hardware Components8-358.3.3Extended Exadata Storage Server X9M-2 Hardware Components8-368.3.4Extreme Flash Exadata Storage Server X8M-2 and X8-2 HardwareComponents8-36x

8.3.5High Capacity Exadata Storage Server X8-2 and X8M-2 HardwareComponents8-378.3.6Extended Exadata Storage Server X8-2 and X8M-2 Hardware Components8-378.3.7Extreme Flash Exadata Storage Server X7-2 Hardware Components8-388.3.8High Capacity Exadata Storage Server X7-2 Hardware Components8-388.3.9Extreme Flash Exadata Storage Server X6-2 Hardware Components8-398.3.10High Capacity Exadata Storage Server X6-2 Hardware Components8-398.3.11Extreme Flash Exadata Storage Server X5-2 Hardware Components8-398.3.12High Capacity Exadata Storage Server X5-2 Hardware Components8-408.3.13Exadata Storage Server X4-2L Hardware Components8-408.3.14Exadata Storage Server X3-2L Hardware Components8-408.3.15Exadata Storage Server with Sun Fire X4270 M2 Servers HardwareComponents8-41Exadata Storage Server with Sun Fire X4275 Servers Hardware Components8-418.3.168.49Spares Kit Components for Oracle Exadata Database MachineHardware Components of the Exadata Storage Expansion Rack9.1Components of Oracle Exadata Storage Expansion Rack X9M-29-19.2Components of Oracle Exadata Storage Expansion Rack X8M-29-29.3Components of Oracle Exadata Storage Expansion Rack X8-29-39.4Components of Oracle Exadata Storage Expansion Rack X7-29-39.5Components of Oracle Exadata Storage Expansion Rack X6-29-49.6Components of Oracle Exadata Storage Expansion Rack X5-29-49.7Components of Oracle Exadata Storage Expansion Rack X4-29-59.8Components of Oracle Exadata Storage Expansion Rack X3-29-69.9Components of Oracle Exadata Storage Expansion Rack with Exadata StorageServer with Sun Fire X4270 M2 Servers9-79.10Part III108-41Spares Kit Components for Oracle Exadata Storage Expansion Rack9-8Cabling Information for Oracle Exadata Database MachineCabling Tables for Exadata Database Machine X9M10.1Rack Layout10-110.2Integrated Lights Out Manager (ILOM) Cabling10-310.3Administrative Ethernet Port Cabling10-510.4Single Phase Power Distribution Unit Cabling10-710.4.1Single Phase PDU Cabling for Exadata Database Machine X9M-2 Full Rack10-810.4.2Single Phase PDU Cabling for Exadata Database Machine X9M-8 Full Rack10-910.5Three-Phase Power Distribution Unit Cabling10-9xi

10.5.1Three-Phase PDU Cabling for Exadata Database Machine X9M-2 Full Rack10-1010.5.2Three Phase PDU Cabling for Exadata Database Machine X9M-8 Full Rack10-1110.611RDMA Network Fabric Network Cabling10.6.1RDMA Network Fabric Cabling for Exadata Database Machine X9M-210-1210.6.2RDMA Network Fabric Cabling for Exadata Database Machine X9M-810-16Cabling Tables for Exadata Database Machine X8M11.1Rack Layout Diagrams11-111.2Integrated Lights Out Manager (ILOM) Cabling Tables11-311.3Administrative Ethernet Port Cabling Tables11-511.4Single Phase Power Distribution Unit Cabling Tables11-711.4.111.4.211.511.5.211.6Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 FullRack11-8Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 FullRack11-9Three-Phase Power Distribution Unit Cabling Tables11.5.11210-1211-10Three-Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 FullRack11-10Three Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 FullRack11-11RDMA Network Fabric Network Cabling Tables11-1211.6.1RDMA Network Fabric Network Cabling Tables for X8M-2 Racks11-1311.6.2RDMA Network Fabric Network Cabling Tables for X8M-8 Racks11-16Cabling Tables for Oracle Exadata Database Machine X8-2, X8-8, X7-2,and X7-812.1Rack Layout Diagrams12-112.2Sun Integrated Lights Out Manager Cabling Tables12-412.3Administrative Gigabit Ethernet Port Cabling Tables12-512.4Single Phase Power Distribution Unit Cabling Tables12-712.4.112.4.212.4.312.4.412.5Single Phase PDU Cabling for Oracle Exadata Database Machine X8-2 FullRack12-8Single Phase PDU Cabling for Oracle Exadata Database Machine X8-8 FullRack12-9Single Phase PDU Cabling for Oracle Exadata Database Machine X7-2 FullRack12-10Single Phase PDU Cabling for Oracle Exadata Database Machine X7-8 FullRack12-11Three-Phase Power Distribution Unit Cabling Tables12.5.112-12Three-Phase PDU Cabling for Oracle Exadata Database Machine X8-2 FullRack12-12xii

12.5.212.5.312.5.412.613141516Three Phase PDU Cabling for Oracle Exadata Database Machine X8-8 FullRack12-13Three-Phase PDU Cabling for Oracle Exadata Database Machine X7-2 FullRack12-14Three Phase PDU Cabling for Oracle Exadata Database Machine X7-8 FullRack12-15InfiniBand Network Cabling Tables12-16Cabling Tables for Oracle Exadata Database Machine X6-2, X6-8, X5-2,and X5-813.1Rack Layout Diagrams13-113.2Sun Integrated Lights Out Manager Cabling Tables13-513.3Administrative Gigabit Ethernet Port Cabling Tables13-813.4Single Phase Power Distribution Unit Cabling Tables13-1113.5Three Phase Power Distribution Unit Cabling Tables13-1413.6InfiniBand Network Cabling Tables13-17Cabling Tables for Oracle Exadata Database Machine X4-2 and OracleExadata Database Machine X4-8 Full Rack14.1Rack Layout Diagrams14-114.2Sun Integrated Lights Out Manager Cabling Tables14-514.3Administrative Gigabit Ethernet Port Cabling Tables14-814.4Single Phase Power Distribution Unit Cabling Tables14-1114.5Three Phase Power Distribution Unit Cabling Tables14-1414.6InfiniBand Network Cabling Tables14-17Cabling Tables for Oracle Exadata Database Machine X3-2 and OracleExadata Database Machine X3-8 Full Rack15.1Rack Layout Diagrams15-115.2Sun Integrated Lights Out Manager Cabling Tables15-515.3Administrative Gigabit Ethernet Port Cabling Tables15-815.4Single Phase Power Distribution Unit Cabling Tables15-1115.5Three Phase Power Distribution Unit Cabling Tables15-1415.6InfiniBand Network Cabling Tables15-17Cabling Tables for Oracle Exadata Database Machine X2-2 and OracleExadata Database Machine X2-8 Full Rack16.1Rack Layout Diagrams16-1xiii

171816.2Keyboard, Video and Mouse Network Cabling Tables16-516.3Sun Integrated Lights Out Manager Cabling Tables16-716.4Administrative Gigabit Ethernet Port Cabling Tables16-916.5Single Phase Power Distribution Unit Cabling Tables16-1216.6Three Phase Power Distribution Unit Cabling Tables16-1516.7InfiniBand Network Cabling Tables16-18Cabling Tables for Oracle Exadata Storage Expansion Rack X9M-217.1Rack Layout17-117.2Integrated Lights Out Manager (ILOM) Cabling17-317.3Administrative Network Cabling17-317.4Single Phase Power Distribution Unit Cabling17-417.5Three Phase Power Distribution Unit Cabling17-517.6RDMA Network Fabric Cabling17-6Cabling Tables for Oracle Exadata Storage Expansion Rack X8M andEarlier18.1Storage Expansion Rack Layout Diagrams18-118.2Integrated Lights Out Manager (ILOM) Cabling Tables18-818.3Administrative Network Cabling Tables18-1318.4Single Phase Power Distribution Unit Cabling Tables18-2018.5Three Phase Power Distribution Unit Cabling Tables18-2818.6RDMA Network Fabric Network Cabling Tables18-3718.6.118.6.218.6.318.6.4ARDMA Network Fabric Cabling for Oracle Exadata Storage Expansion RackX8M-218-38InfiniBand Network Cabling for Oracle Exadata Storage Expansion X7-2,X6-2 and X5-218-39InfiniBand Network Cabling for Oracle Exadata Storage Expansion Rack X4-2and X3-218-41InfiniBand Network Cabling for Oracle Exadata Storage Expansion with SunFire X4270 M2 Servers18-48Components of Exadata Database MachineA.1Obtaining Information about Exadata Database Machine ComponentsA-2xiv

PrefaceThis guide describes Oracle Exadata Database Machine for online transaction processing(OLTP) and enterprise data warehousing. It includes information about the components,restrictions and cabling. Audience Documentation Accessibility Diversity and Inclusion ConventionsAudienceThis guide is intended for Oracle Exadata Database Machine customers and thoseresponsible for data center site planning, configuration, and maintenance of Oracle ExadataDatabase Machine.Documentation AccessibilityFor information about Oracle's commitment to accessibility, visit the Oracle AccessibilityProgram website at http://www.oracle.com/pls/topic/lookup?ctx acc&id docacc.Access to Oracle SupportOracle customers that have purchased support have access to electronic support through MyOracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx acc&id infoor visit http://www.oracle.com/pls/topic/lookup?ctx acc&id trs if you are hearing impaired.Diversity and InclusionOracle is fully committed to diversity and inclusion. Oracle respects and values having adiverse workforce that increases thought leadership and innovation. As part of our initiative tobuild a more inclusive culture that positively impacts our employees, customers, andpartners, we are working to remove insensitive terms from our products and documentation.We are also mindful of the necessity to maintain compatibility with our customers' existingtechnologies and the need to ensure continuity of service as Oracle's offerings and industrystandards evolve. Because of these technical constraints, our effort to remove insensitiveterms is ongoing and will take time and external cooperation.ConventionsThe following text conventions are used in this document:xv

PrefaceConventionMeaningboldfaceBoldface type indicates graphical user interface elements associatedwith an action, or terms defined in text or the glossary.italicItalic type indicates book titles, emphasis, or placeholder variables forwhich you supply particular values.monospaceMonospace type indicates commands within a paragraph, URLs, codein examples, text that appears on the screen, or text that you enter. promptThe dollar sign ( ) prompt indicates a command run as the oracleuser.# promptThe pound (#) prompt indicates a command that is run as the rootuser.xvi

1Introduc

Part I What's New in Oracle Exadata Database Machine 2 New Features for Oracle Exadata System Software Release 21.x 2.1 What's New in Oracle Exadata Database Machine 21.2.0 2-1 2.1.1 Exadata Database Machine X9M Support 2-1 2.1.2 Persistent Storage Index 2-2 2.1.3