RHEL6PlanningHighAvailability& SharedStorageClusters

PerryMyers,LonHohberger May27,2009

HighAvailabilityandClusterCluster3.x Goals

HighLevelRequirements/Goals

OnlineupgradesfromCluster2.x(Fedora9/RHEL5.4)clusterstoCluster3.x (RHEL6/Fedora11/12) CommonclusterinfrastructureforLinuxHighAvailabilitycommunityandbetter integrationwithotheropensourceprojects Simplificationandmoremodularity EnhancedEaseofUse ImprovedPerformance EnhancedAPIs EnhancedResourceManagement Continuetomakeprogressonimplementingclusterstoragefeatures Tightervirtualizationintegration

ClusterInfrastructureCorosync/Openais
Openais/CorosyncSplit

ProvidescommonclustercommunicationsmechanismforLinuxclusters Allmajordistributionswillbeincludingtheseprojects

CorosyncClusterEngine

Openais

TotemandExtendedVirtual Synchronycommunications ServiceEnginesClosed ProcessGroups,Configuration Database InterprocessCommunications Protocol RDMA/Infinibandsupportfor Totem(usedbyMRGqpid brokers)

ImplementsServiceAvailability ForumInterfaceSpecifications CheckpointServicealreadyin RHEL5 AvailabilityManagement Framework(AMF),Message Service,EventService,Log Service,DistributedLockService

ClusterInfrastructureCMAN

ClusterMembership

ClusterConfigurationProvidemultipleoptionsforconfigurationstorage

cluster.conf,corosync.conf,openais.conf LDAP Extensibletoaddadditionalconfigloaders Dynamicreloadingofconfigfilesfornearlyallclustercomponents

ClusterQuorumIntegratedasamoduleinsideofcorosync Improvedmodularitytoallowbettercommunityintegrationandnotification systemforintegrationwith3rdpartycomponents Abilitytoremoveclusternodeswithoutclusterrestart SupportsCorosync/Openaissplit Configurationmodeliscleanedup LDAPcapableforconfigurationstorage RicciusedforclusterconfigurationfiledistributionCCSDhasbeen removed

Fedora11/12,RHEL6Changes

ClusterInfrastructureDLM/GFS

DLM/GFS

DirectIntegrationwithcorosyncimplementedandalayerofcoderemoved RedHatspecifictranslationlayerremovedallowingsupportfornonRH componentssuchasOCFS2 CompatibilitymodewithRHEL5.4interfacestoallowonlinecluster update/migrationtoFedora11/12,RHEL6 Evolutiontoallowintegrationwithmoreprojects SupportsOCFS2 ImplementsclusterposixlockingforLinuxindependentoftheunderlying filesystems Simpler,smallerandfasterinterfacesforclustercomponents.

DLM

Fencing

SeparateoutfenceagentsfromcmanRPM Supportfornewhardware GenericSNMPlibraryforcreatingnewSNMPbasedagents(includedin RHEL5.4) Supportforunfencing(forfabricfencesincludingfence_scsi) Hardeningoffence_scsiforuseasaprimaryfencingdevice(alreadysupported inRHEL5,butwillbetestingadditionalhardwaredevices)

CrosscomponentGoals

SELinuxTargetedsupportforClusterNodes

Creationofpercomponentselinuxpolicies

Integrationwithsystemconfigfirewall/lokkitforconfiguringdefaultclusterports Standardizedloggingsystemacrossclustercomponents IPV6Support ImprovedPerformance

Anecdotalevidencefromcommunitymembersthatcluster3isfasterinthe areaofgroupd/dlm_controld/gfs_controldduetocoderefactoring.Needto quantifythisperformancegain. Couldbeintegratedw/Congatomakeuserinterfacemoredynamic

Relaxngschematoexportallconfigurationdata

Virtualization

ClusterSuiteinRHEL5supportstwomethodsofsupportingvirtualization

RunningVMsasaservicemanagedbyrgmanager

Guestneednotberunningclustersuite,andcaninfactbeanonRHEL OS(Windowsorother) GuestandHostmustbothbemembersofacluster Requirementbroughtinbyfencexvmdwhichusescheckpointingtotrack VMtohostmapping fencexvmdusesnetworkingfromguesttohost

RunningclustersuitedirectlyinVMs

Virtualization

Conversiontolibvirtfromxmbasedcommandsettosupportmultiplehypervisors (KVM/Xen)

ThiswillbeinRHEL5.4

fence_xvmdrefactoredtomakeiteasiertodeploy RHEL6possibleimprovements

Implementationofserial/virtiobasedfenceforVMs fence_xvmdextendedtosupportboththeserial/virtioornetworkagent fence_xvmdusesalternativemechanismfortrackingVM/hostmapping

libvirtqpid(QMF)interface Managementserver(RHEVMoroVirtServer)

fence_xvmdneedstocallouttosecondarypowerfenceconfigurationiflibvirt basedfencingfails Possiblyrenamingfence_xvm{d}sothatthenameofisnotXenspecific:)

VMware/HyperVIntegration

VMware

RHEL5.3providedfence_vmwarewhichcanbeusedonESXhostsrunning gueststhatarepartofacluster Newfence_vmwaredevelopedupstreamthatsupportsintegrationwithVirtual Centerproviding:

Migrationtracking Integrationwithfabricfencing(SCSIreservations)

Developmentofthisupdatedagentiscomplete,butwelacksufficientQE resourcesandequipmentpresentlytoproperlytesttohavefullconfidencein thesolution Shouldbesimilartodevelopmentofvmware_fenceagent Thiseffortisonholdpresentlyasthiseffortislowerprioritythanotherwork goingon(andaswithVMwarewelackQEresources)

HyperV

ResearchAreas

Pacemaker

EvolutionoftheLinuxHAproject ClusterResourceManager ProvidesFinergrainresourcemanagementthanrgmanager Investigationsunderwayonhowtoleveragewithinourcurrentarchitecture Possiblesincecorosync/openaisiscommontoboth SincewerequirerollingupgradesfromRHEL5toRHEL6weneedto continuetosupportrgmanagerinRHEL6,butpacemakercouldbeincluded asanalternativeforuseinnewclusters. LikelywillbeTechPreviewinRHEL6.0 Willallowustoeffectivelyincreaseclustersizesbeyond32Nodes WillprovidesupportformultisiteusageofOpenAIS/Corosync(overhigh latencyWANlinks)

MultiringsupportforTotem

ResearchAreas

MultisiteClusterSupport

RunningasingleclusterwherenodesareseparatedbyaWANlink Featurerequestedbyproductmanagement,butunclearontheusecasesor customerdemand RequiresmultiringsupportfromTotem Cannotsupportsharedstoragebetweensites,insteadstorageateachsite willbereplicated rgmanager'suseofcheckpointwhichreliesondlmmaybeproblematic, pacemakermaybeagoodsolutionhere PowerfencingoveraWAN? Thisfeaturewillnotmake6.0,willneedtoconsiderforapointrelease Subpackagefence_agentstomakedependencieseasiertodealwith

Fencing

ClusterManagement

StillsomedebateaboutstatusofCongainRHEL6,workingtoresolvethisASAP Congaconsistsofricciandluci RicciC++agentoneachNode

AlreadyinFedora11 Leveragedbyclustermanagementforconfigurationdistribution NeedstobeupdatedtosupportlatestSTABLE3clusterfeatures IntegrationwithMRGQMFtoprovidecommoninfrastructurefortransport Needsstorageextensionstohandlemultipath,iscsi,etc...

ClusterManagement

LuciServerandWebUI(twopossiblepathsinRHEL6)

Luciisdeprecated:

RecommendusageRHEL5.4runninglucitomanageRHEL6clusters Waitfornextgenintegratedmanagementapplicationtoreplaceluci RewriteofZope/PloneimplementationusingTurbogears PackagingZope/PloneandolderversionofPythoninRHEL6

LuciisoverhauledtoruninRHEL6usingeither:

WiththeTurbogearsportwewouldgetanewlookandfeelfortheUIbasedon inputandmockupsfromtheUIdesignteam Ifweproceedwithfurtherdevelopmentofluciwemaywanttoimplement:

StorageSubsystemrewriteintosupportable/modifiablecode

iSCSIconfigs MultipathConfigurations Scalabilityenhancementsforlargestorage

Conga2UIDesignMockup

UpstreamStatus

Corosync1.0releaseshouldbecompletebyJuly1

Rollingupgradesupport(syncv2)underdevelopment ImplementationofDistributedLockandMessageservicesnearlydone DevelopmentwillbeginafterOpenAIS/Corosync1.0releases BetaofthisshouldbeavailablebymidAugust

OpenAIS1.0releasesshouldbecompletebyJuly15

RDMA/InfinibandSupportforTotem

STABLE3clusterreleasecandidatesavailable,shouldmoveto1.0release shortlyafterOpenAIS/Corosync1.0release TargetistogetcompleteSTABLE3releaseintoF12,F11updateswillfollow

FeaturePagesStatus

ClusterPackagingCompleteinF11 FencingAgentsCompleteinF11 StandardizedLoggingSystemCompleteinF11 PluggableConfigurationSystemCompleteinF11 IPV6SupportCompleteinF11 CorosyncClusterEngineNearing1.0releaseendofJune(F11updates) OpenAISServicesNearing1.0releasemidJuly(F11updates) RollingUpgradesfromRHEL5ClustersCompletedinmostcomponents,work stillunderwayforCorosync,willbereadyforCorosync1.0release KVMBasedVirtualMachineClustersCodecompletedinRHEL5.4astech preview.AdditionaltestingeffortrequiredforRHEL6forfullsupport

FeaturePagesStatus

InfinibandSupportNotstarted,betaofthisreadybymidAugust MultisiteSupportNotstarted,deferreduntilpostRHEL6.0 SELinuxIntegrationInitialinvestigation,needsfurthertestinganddevelopment ofselinuxpoliciesforcomponents IPTablesConfigurationSupportBugfiledw/systemconfigfirewallcomponent QMFModel/qpidTransportforRicciAgentPrototypeinprogress NeedAdditionalFeaturePagesfor:

VirtualizationEnhancements VMwareVirtualCenterSupport

Questions?