Transcription
Demystifying Big DataGovernment Agencies & The Big Data Phenomenon
Today’s DiscussionIf you only remember four things21Intensifying business challenges coupled with an explosion indata have pushed agencies to a tipping point2Agency leaders embrace this, are defining the newrequirements, and are demonstrating success3The path to success lies in starting with business challengesand imperatives, versus the technology.4The time is now – the experience & assets exist to help youdefine a strategy and a roadmap to guide your transformation
Quick SummaryBig Data Commission Report Released 3 October The Commission was formed in May IBM & SAP Named as Chairs Brought together experts fromGovernment, Academia and Industry The report seeks to “De-Mystify” Big Data,and focus on the business and missionvalue it will deliver Intent is to Provide clear recommendationsand a roadmap for getting startedCopyright 2012 IBM Confidential3
Big Data CommissionScope & ApproachThe Big Data Commission will provide guidance to the White House andCongress on the use of Big Data to improve government efficiency, servicesand capabilities, and drive innovation and the economy.Overall Approach1. Approach the work from the perspective of Government Business/MissionImperatives, and the potential value that leveraging Big Data can provide.2. Frame the discussion through the lens of early best practices, and keylessons learned3. Extract recommendations on how to assess potential operational businessvalue; technical underpinnings; policy, security, privacy and governanceconsiderations4. Provide a practical, experience based roadmap for getting started
Something Profound is HappeningContinuous transformation is the new normalBusiness models areunder constant threat Shift of power to the consumerand the citizenConvergence of technologydisruptors creates opportunityCloudMobileSocial Accelerating pressure to domore with less Great relationships trumpgreat productsInternetof Things not changing isthe same as losing5
Government’s Must Lead In The Face of Global Challenges –Key Drivers Of Transformation Creating New ExpectationsKey Drivers of TransformationRequired BusinessOutcomesChanging DemographicsMaximize compliance& revenueGrowing Threats to SocialStability and OrderEvolving SocietalRelationshipsRising EnvironmentalConcernsExpanding Impact ofTechnologyEXTREME BUDGET PRESSUREAccelerating GlobalizationImproved citizenservices & experienceIntensifying InformationRequirementsRecognize and optimize serviceto the citizen, soldier, veteran,and patient at any point ofcontactLeverage improved insight tomanage effectiveness, predictfuture demands and requirementsManage ResourcesEffectively, ReduceWaste & FraudPro-actively recognize andmitigate patterns of fraud, abuseand non-complianceStrengthen publicsafety and defenseEnabling defense, intelligence andlaw enforcement organizations toachieve situational awarenessTransparency andaccountabilityProvide transparency to anever more demanding publicShare information across andbetween agencies
What Is Big Data, Really?Big Data is all data from everywhere - the next natural resource“We have for the first time an economy based on a key resource [Information] that is not onlyrenewable, but self-generating. Running out of it is not a problem, but drowning in it is”-- John Naisbitt25 zettabytes worth ofdata will exist by 2020Volume30 billion RFID sensorsand countingVelocity80% of the world’sdata is unstructuredVariety1 in 3 business leadersdon’t trust the informationthey use to make decisionsVeracity harvesting this resource requires mining, refining and delivering7
Agencies Leading The WayOptimize decision making with actionable insightsVarietyLacktyto predict of VelocityPrior Path to SuccessToday’s LeadersSense and RespondPredict and ActInstinct and IntuitionReal-time, Fact-drivenSkilled Analytics ExpertsEveryoneBack Office Decision SupportPoint of ImpactAutomated ProcessesOptimizedbility to predictcient accesshtVarietyelocity8
Leading The WayGovernment Agencies Harnessing The Value of Big DataAdvanced return review analyticsthrough Fraud AnalyticsSmarter Revenue:Tax ComplianceSmarter Social ServicesHeatlh & SocialServices AgencyIn Four Hours Identified 140M inImproper PaymentsSocial Media AnalyticsEfficiently read, process and analyze largevolumes of political debate-related, publicfeedback in real-timeSmarter HealthCare AnalyticsHigh performance analytics across a vastvolume of data to spot hidden trends andrelationships9Smarter Law Enforcement30% Reduction in Violent Crime
Leading The WayGovernment Agencies Harnessing The Value of Big DataNational Border & SecurityState of The Art covert surveillance systembased on Streams platformSmarter Social Services:Smarter Health Care AnalyticsOptimized Neo-Natal care through earlydetection, prevention, testing hypothesesSmarter CitiesReduced traffic congestion, shorter traveltimes, enhance emergency servicesSmarter Energy:Wind InfrastructureOptimized wind turbine energy productionwith longer life span and reducedmaintenanceSmarter HealthCare AnalyticsHigh performance analytics across a vastvolume of data to spot hidden trends andrelationships with Netezza
Leading The WayGovernment Agencies Harnessing The Value of Big DataSmarter EnergyEnhanced collaboration across theelectrical grid for greater demand andmaintenance efficiencySmarter Resource Management:Watershed IntelligenceEarly and accurate detection andnotification of events effecting watershedSmarter Cities:Crime Prediction & PreventionImproved case closure rates and reducedcrime with static or reduced staffing levelsSmarter Cities:Energy ConsumptionSmarter Revenue Management:Tax ComplianceLarge EuropeanUniversityGenerates own energy and uses analyticsto monitor and manage consumptionEuropean TaxAgency12X performance improvement in complexreport generation, and Ad Hoc queriespossible for the first time
Leading the WayNaval & Maritime Threat Intelligence12
Big Data Commission ReportKey FindingsBig data has the potential to profoundlytransform Government and the society that itserves.The great paradox is that as Big Data iscontinually produced and information is create,we struggle to keep pace. Our ability to makesense of it is reduced.Leaders across government, academia andprivate industry have made investments, havedemonstrated success, and we now know whatsuccess looks like.These experiences reveal a great irony -- thatwhile the impact of Big Data is betransformational, the path to effectivelyharnessing it is not. The journey is evolutionaryversus revolutionaryIt starts with understanding the businessrequirement, the data available, and the “Art ofthe Possible”
What We Have LearnedBig Data Requires A Different Approach – It Breaks The Traditional Analytics ModelBig Data ApproachTraditional ApproachBusiness UsersITDetermine whatquestion to askDelivers a platform toenable creative discoveryITBusinessStructures thedata to answerthat questionExplores whatquestions could beaskedStructured & Repeatable Analytics Query Based -- Question Drive Data Citizen Surveys - Push Monthly, Weekly, Daily Data At RestVS.Iterative & Exploratory Analytics Autonomic -- Insight Drives Answers Citizen Sentiment -- Pull Persistent & Ad Hoc Data In Motion
What We Have LearnedA Set of Capabilities That Move the Analytics Closer to the DataNew analytic applications drive therequirements for a Big Data platform Integrate and manage the fullvariety, velocity, and volume of data Apply advanced analytics toinformation in its native formAnalytic ApplicationsBI /Exploration / Functional Industry Predictive ContentBI /Reporting VisualizationAppAppAnalytics AnalyticsReportingIBM Big Data PlatformVisualization& Discovery Visualize all available data for adhoc analysis Development environment forbuilding new analytic applications Workload optimization ouse Security and governanceInformation Integration & Governance
Taking It To The Next LevelApplying advanced analytics to improve decision makingWhat ishappeningHow many,how often,where?Whatexactly istheproblem?StructuredData &UnstructuredContentMadeconsumableand accessibleto everyoneWhatactions areneeded?DescriptiveAnalytics (BI)What couldhappen?SimulationWhat ifthesetrendscontinue?ForecastingHow can weachieve the bestoutcome?OptimizationWhat willhappennext if?PredictiveModellingHow can weachieve the bestoutcome andaddress icsPrescriptiveAnalyticsCopyright 2012 IBM ConfidentialExtractinginsight,concepts andrelationshipsContentAnalyticsDeep insightsto improveweb sites andmarketinginteractionsSocial Media &Web Analytics16
Big Data CommissionGetting Started – Recommendations For AgenciesBig Data is here -- and it is accelerating.For government agency leaders focused on taking the first steps, theCommission makes the following recommendations:1. Understand the “Art of the Possible”.2. Start with a clear mission or business requirement, and fully define adiscrete set of use cases.3. Take inventory and understand your data assets.4. Assess your current set of capabilities and technical architecture againstwhat is required to support your initial use cases.5. Explore which data assets can be exposed for public consumption, to driveinnovation and the development of Big Data solutions.
What We Have LearnedThe Key Lies in Building Trusted Information Is Critical -- On Multiple LevelsInsightfulComprehensive analytics to drivenew meaning from your dataCan I extract new Insight to make it all worthwhile?Governed & SecureRules are in place and tools are deployed to limit visibility,secure sensitive information, and protect privacyCan I Trust My Partner and My Own Agency?Accurate & CompleteComplex and disparate data transformed, cleansed,reconcile and deliveredCan I Trust The Information?
Today’s DiscussionIf you only remember four things1Intensifying business challenges coupled with an explosion indata have pushed agencies to a tipping point2Agency leaders embrace this, are defining the newrequirements, and are demonstrating success3The path to success lies in starting with business challengesand imperatives, versus the technology.4The time is now – the experience & assets exist to help youdefine a strategy and a roadmap to guide your transformation19
Leverage improved insight to manage effectiveness, predict future demands and requirements Recognize and optimize service to the c
