Post on 13-Jan-2015
description
Copyright © 2013 EMC Corporation. All Rights Reserved.
Big Data
Rafael Borges
EMC Centro de P&Drafael.araujoborges@emc.com
Copyright © 2013 EMC Corporation. All Rights Reserved.
Agregando valor à informação através de mudanças de TI
EMC Expertise
Otimização de infraestrutura através
de virtualização
Transformando negócios com o uso de ferramentas
analíticas
CLOUD BIG DATACyber security, compliance e
gerência de risco
Security
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Atuação
ENTERPRISE APPLICATIONS BIG DATA APPLICATIONS
IonixVPLEX
Data Domain, Avamar, NetWorker
VNXVNXe
VMAXVMAXe Isilon Atmos
Pivotal
Copyright © 2013 EMC Corporation. All Rights Reserved.
P&D
Estratégia de Inovação
Aquisição de Tecnologias
12%Investment
10%Investment
Copyright © 2013 EMC Corporation. All Rights Reserved.
EMC’s Big Data R&D Center in Brazil
Applied Research Center at the heart of the Technology Park in Rio Purpose built facility located with the
University Campus / Technology Park Complex
Industry Leading Technology Ecosystem: Schlumberger, Halliburton, BG, Siemens, GE, Petrobras, and others
50+ EMC Big Data Scientists Collaborating with 50+ others on Campus Joint projects with leading technology and
O&G companies Solution Development and Certification
World Class Executive Briefing Center
Copyright © 2013 EMC Corporation. All Rights Reserved.
O que é Big Data, afinal
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Big Data Refers To…• All Data that comes at high Volume
• All Data that comes at high Velocity
• All Data that comes from a Variety of Sources
• All Data that brings Complexity
• All Data that challenges existing Information Infrastructure Capabilities
• All Data that makes us “Think Different” Today
Copyright © 2013 EMC Corporation. All Rights Reserved.
IN 2010 THE DIGITAL UNIVERSE WAS
1.2 ZETTABYTES1,200,000,000,000,000,000,000
Zetta Exa Peta Tera Giga Mega Kilo Byte
Source: 2010 IDC Digital Universe Study
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Avalanche desta década
20090.8 Zettabytes
CRESCIMENTODA INFORMAÇÃO
2020
44X
MAIOR35.2 ZB
fONTE: IDC Digital Universe Study, patrocinado pela EMC, 2011
O NÚMERO DE PROFISSIONAIS DE TI NO MUNDO VAI CRESCER
MENOS QUE 50%
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Ondas de evolução
Computação em nuvem
Minicomputador
Mainframe
PC/ Microprocessador
Redes/Computação distribuída
Copyright © 2013 EMC Corporation. All Rights Reserved.
Com a “Nuvem”, agora estamos prontos para a era da conectividade
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
O que está causando essa avalanche de dados?
Exploração Geofísica
Imagens médicas
Vídeos de vigilânciaSensores móveis
Renderização de Vídeos
Sequenciamento de gens
Smart Grids
Redes sociais
LER MEDIDORES A CADA 15 MIN GERA 3,000X MAIS DADOS
O CUSTO DE SEQUENCIAR UM GENOMA CAIUDE $100M EM 2001 PARA $10K EM 2011
FACEBOOK CRESCE COM APUBLICAÇÃO DE250 MILHÕESDE FOTOS/DIA
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Big Data é um conceito relativo
O que é grande hoje…Pode não ser tão grande amanhã….
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Fontes de Dados Crescem Sem Parar
Source: 2011 IDC Digital Universe Study
CRESCER 50X
Nos próximo 10 anos
Informações nas empresas irá
Copyright © 2013 EMC Corporation. All Rights Reserved.
Source: 2011 IDC Digital Universe Study
90%DO MUNDO DIGITAL É
NÃO ESTRUTURADO
Copyright © 2013 EMC Corporation. All Rights Reserved.
Então… Tudo que preciso é gerenciar Big Data, certo?
Copyright © 2013 EMC Corporation. All Rights Reserved.
Errado!
Copyright © 2013 EMC Corporation. All Rights Reserved.
Big Data Is About
Copyright © 2013 EMC Corporation. All Rights Reserved.
Big Data Is AboutPredictive Analytics
Copyright © 2013 EMC Corporation. All Rights Reserved.
E quem fará essa revolução?
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
E quem é o Cientista de Dados?
BI foca no gerenciamento e reporte de dados existentes para monitorar e gerenciar questões tangentes ao empreendimento.
Data Science aplica avançadas ferramentas e algorítimos de análise para criar novas informações e inovações que são um desdobramento direto dos dados originais
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Alto
FuturoPassado TEMPO
VALORDO
NEGÓCIO
Data Science
Business Intelligen
ce
Baixo
Data Science
• Análises Preditivas
• E se…?
Business Intelligence
• Relatórios
• O que aconteceu?
Qual a diferença?
Copyright © 2013 EMC Corporation. All Rights Reserved.
Perfil de um Cientista de Dados
Técnico
Quantitativo
Curiosidade&
Creatividade
Comunicativo&
Colaborativo
Cético
Copyright © 2013 EMC Corporation. All Rights Reserved.
EMC Oil And Gas Strategy
ADVANCE existing EMC oil and gas
solutions
LEVERAGE a robust partner
ecosystem
RESEARCH inventing the next
generation of applied technologies
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Volume
• Seismic– SEGD, Pre-Stack, Post-Stack
• Navigation
Variety
• Recently Acquired and Historical – Log curves– Production data– Drilling and test – Micro seismic
– Tops– Lithology– Cultural– Cores
Velocity
• Real Time– LWD– MWD– Mud logging– Rate of Penetration
– Flow– Pressure
Exploration DevelopmentEngineering
and Production
– Seismic acquisition
– Seismic processing
– Seismic interpretation
– Geological interpretation
– Drilling & Test– Reservoir Modeling
– Reservoir Simulation
– Facilities & Reservoir Engineering
– Drilling program
– Production Development and Optimization
– Production
Big Data Definition: Upstream
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Data Acquisition
Seismic Processing
Interpretation
Drilling
Production
Data Lifecycle Management
Data Dependent Compression
Integrating Wireless Sensors & Analytics
Visualization and Collaboration over Distance
Optimized I/O Platforms for Processing
Analytics for Risers Integrity Management
Plug-in Development
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Data Acquisition
Seismic Processing
Interpretation
Drilling
Production
Data Lifecycle Management
Scientific Workflow Optimization
Complex Data Pattern Recognition
Time Series Data Uncertainty Analysis
Remote User Data Protection Plug-ins
Optimized RTM ; FWI Processing Platforms
Mega-survey Mobility and Distribution
Edge Data Mobility and Transport
Condition Based Maintenance Analytics
Logistics Optimization / Incident Management Analytics
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.
Data Acquisition
Seismic Processing
Interpretation
Drilling
Production
Data Lifecycle Management
Partition Tolerant Storage Architectures
3D Application Cloud Virtualization Architecture
Topside Plant and Process Analytics
Production Optimization Analytics
HPC Checkpoint Optimization
In-memory HPC architectures
Analytics for Drilling Intervention / EHS
Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved. 29
OBRIGADO!