Tag Archives: Hadoop

3 Insights from Industry Leaders at 10Fold’s Inaugural Big Data Horizon Event

With 10Fold’s first ever Big Data Horizon (BDH) event coming to a close last week, we’re sharing some of the key takeaways on what industry leaders are focusing on as they build their data strategies.

  • Big Data & Big Legal

With the ever-increasing complexity of data collection and a growing number of embedded sensors in the products used by enterprises, legal’s role in safeguarding such data was top of mind at BDH. George Gilbert, Lead Analyst for Big Data & Analytics at Wikibon, noted that technologies like “digital twins”, which provide the entire lifecycle data for products, will have far-reaching legal ramifications. Digital twin technology will likely raise unique challenges for enterprises that outsource data collection and analysis, as they will have to contend with new issues in data ownership and potential leakages.

  • No More “Machine Learning”?

Big Data as an industry is rife with buzzwords, fads, and controversy. Often concepts in data science take on several name changes as technologies are either innovated upon or fade away in deference to competing technologies. Just as the term “perceptron” fell to neural networks, many participants at the BDH did not believe that “machine learning” would last as a phrase in the Big Data lexicon.

  • Enabling Citizen Data Scientists

Software will increasingly take up a larger share of the pie with hardware and infrastructure maturing as market segments. These shifts will eventually translate into a greater number of power users and citizen data scientists taking on some of the less specialized aspects of data science, with many new tools emerging to cater to this audience. If this trend continues, employers will increasingly look for people who have an idea about data science fundamentals to bridge skill gaps as they look to apply data to business processes.

Are these trends in line with what you heard at Big Data Horizon, or if you weren’t able to make it to the event, have you been hearing similar things in your Big Data world? Let us know in the comments or on 10Fold’s Twitter, Facebook or LinkedIn.

And a huge thank you to all our first Big Data Horizon attendees. It would not have been a success without you, and we hope to see you all at the next Big Data Horizon event!

10Fold- Security Never Sleeps- 134

Attackers start wiping data from CouchDB and Hadoop databases

“Ransomware groups affect data storage firms”

The inevitable attack from ransomware organizations occurred over the last week, most recently with a data wipe from the databases of MongoDB and Elasticsearch clusters. Hadoop and CouchDB are also experiencing similar attacks.

New Mac malware uses ‘ancient’ code 

“New strain targets biomedical facilities with OS X”

An antiquated strain of malware ‘Quimitchin’ has been discovered by Malwarebytes after unusual outgoing traffic from an outdated Mac operating system was spotted by an IT admin. The research team commented that “in existence, undetected, for some time.”

Billion-dollar Hacker Gang Abuses Google Services To Control Malware

“Over $1 billion stolen from banks globally”

A new Forcepoint report indicates that operators of Carbanak have implemented a new system that allows the cyber-criminals to deliver commands to computers that have suffered from the infection. The infections often spreads through unprotected Google Spreadsheets and Google Forms.

Mobile Security Gap Threatens Enterprises

“New mobile tech causing security concerns”

Two new surveys of IT experts show that malicious software is on the hotlist for researchers. A Ponemon Institute study on behalf of IBM and Arxan found that nearly 84% of IT security practitioners believe that mobile applications are vulnerable to malware threats. IoT application researchers share the concerns at 66%, although at a lower rate.

Meet Our Client BlueData

Located in Santa Clara, California, BlueData simplifies Big Data deployment with its Epic™ platform that helps companies put the infrastructure in place to deploy Big Data apps that offer the insights and solutions their customers need. The Company is led by industry veteran Kumar Sreekanti, former Vice President of R&D at VMware and co-founder of Agami Systems.  Kumar is best known for his seminal work on real-time operating systems, file systems, software and hardware RAID solutions, both prior and during his time at BlueData.

BlueData collaborates with an impressive list of clients with big industry name recognition, including Comcast, AIG, and the United States Department of Homeland Security. BlueData has already won a hefty catalog of accolades, including a spot in the CRN 20 Coolest Platform and Tools Vendors and 2015 Stevie Award Winner: American Business Awards New Big Data ‘Software Product of the Year.’

Find some recent industry coverage of BlueData here, and learn more about BlueData’s product and services in this video:

Enjoy your read? Browse our other blogs as well!

10Fold – Big Data Business Insights – 46

Big Data

10 FOLD ICON 15x15 By 2020, businesses harnessing the power of Big Data should see $430 billion in productivity benefits over competitors not using data, according to International Institute for Analytics.  And today, most companies have the opportunity to bring Big Data to the bottom line. It is therefore not surprising that conversations about Big Data, data analytics and, more recently, cognitive analytics, are dominating corporate conversations. Data analytics finds useful information inside Big Data.  Insights can be descriptive, as when analyzing the percentage of bank customers who use online banking exclusively. Insights can be predictive, as when forecasting the percentage of banking customers who will be using online banking exclusively 10 years from now.  Or insights can be prescriptive, as when recommending whether a bank should expand its online presence or secure commercial space for additional branch offices. Cognitive analytics, a newcomer to Big Data discussion, draws on diverse dynamic learning tools, such as artificial intelligence and artificial neural networks. The horizon for new opportunity through data monetization is vast, as companies transform information collection and use to customer benefit and ultimately, profitability. Although data analytics can tell us the “what,” the “whether” and sometimes the “how to,” redefining data monetization as “leveraging data to generate value” informs corporate conversations with a clearer realization of the monetary value within Big Data.

10 FOLD ICON 15x15 According to Forbes, in 2013 the Journal of Business Logistics published a white paper calling for “crucial” research into the possible applications of Big Data within supply chain management. Since then, significant steps have been taken, and it now appears many of the concepts are being embraced wholeheartedly.Supply chain management is a field where Big Data and analytics have obvious applications. Until recently, however, businesses have been less quick to implement Big Data analytics in supply chain management than in other areas of operation such as marketing or manufacturing. Applications for analysis of unstructured data has already been found in inventory management, forecasting, and transportation logistics. In warehouses, digital cameras are routinely used to monitor stock levels and the messy, unstructured data provides alerts when restocking is needed. Forecasting takes this a step further – the same camera data can be fed through machine learning algorithms to teach an intelligent stock management system to predict when a resupply will be needed. Eventually, the theory is, warehouses and distribution centers will effectively run themselves with very little need for human interaction.

Finding the hidden monetary value of Big Data – The Tennessean

How Big Data And Analytics Are Transforming Supply Chain Management – Forbes

Hadoop

10 FOLD ICON 15x15 The big news in Big Data for the last 12 months has all been about real-time and streaming analytics. Spark, which became a top-level Apache project in 2014, has gained endorsements from every major Big Data player. A new player that’s been stirring up excitement is Apache Flink, a true stream processing engine whose developers recently landed $6 million in financing for their Flink-focused startup, Data Artisans. By 2026, 59 percent of all Big Data spending will be tied to Spark or related streaming analytics as enterprises seek to deploy applications that can make decisions on behalf of individuals. The reasons relate both to speed and simplicity. Hadoop introduced important concepts like moving analytics engines close to the data and incorporating unstructured data into a data lake, but it has developed incrementally into an ecosystem of more than 30 discrete components that can be daunting to coordinate. Spark has added real-time-like features through the Spark Streaming project, but it’s still fundamentally a “micro-batch” architecture for now, meaning that it simulates real-time analytics by processing small volumes of data quickly in batch mode. For most applications Spark is good enough, but true stream processing will demand a combination of Flink and Kafka unless Spark is able to evolve beyond its micro-batch approach by adding per-event streaming.

Spark muscling in on Hadoop’s territory, says Wikibon analyst – SiliconANGLE

IoT

10 FOLD ICON 15x15 Gizmodo reports that the state of Victoria is working with IT and communications companies to test out Narrowband-Internet of Things (NB-IoT) systems in its sewer and water systems. Huawei, Optus and Vodafone are partnering with the state agency South East Water for the trial in urban areas that include Melbourne. NB-IoT is a low-powered, low-cost radio technology that allows thousands of connected devices and infrastructure elements to gather and share data, regardless of the location. The three-month trial seeks to provide operators with access to granular, real-time data to better the safety, reliability and efficiency of Victoria’s sewer and water infrastructure. The trial will see NB-IoT sensors placed on sewer manhole covers to inform city workers of unauthorized access, to reduce the risk of injury and damage to water assets. NB-IoT technology will also be fitted to rainwater tank management systems to monitor storage levels amid efforts to optimize stormwater runoff and rainwater harvesting

IoT gets down and dirty in Australian smart sewers trial – ReadWrite

eCommerce

10 FOLD ICON 15x15 Neil Chandler, CEO of financial services at UK firm Shop Direct makes a statement that arguments reality and tactile technology will be the next change in online shopping. He states that Virtual reality (VR) and augmented reality (AR) are just one or two years away from changing the way consumers shop online. He gives the example that augmented reality would enable consumers to see how a sofa would look in their living room or how would they look in a piece of clothing.

Virtual Reality only two years away from being used in e-commerce industry, says Shop Director FS CEO- Computing UK

 

10Fold – Big Data Business Insights – 45

Big Data

10 FOLD ICON 15x15 Previously confidential documents have shed light on just how much data the UK’s intelligence services have been sifting through for over a decade. The types of data gathered by the intelligence services are wide ranging – Privacy International which revealed the documents said the agencies had the potential to requisition medical records and confidential information shared with a doctor, travel records, financial records, population data, commercial data, and feeds from internet and phone companies including billing data or subscriber details, content of communications and records from government departments. The agencies use this data to spot individuals of interest who might otherwise remain invisible. Following the Edward Snowden revelations, many tech companies improved protection for customer data flowing over the internet, making it hard for spies to tap in. And consumers are increasingly using end-to-end encrypted communications, which not even the companies providing the service can read, shutting out the spies again. As a result hacking and big data analytics will be big areas of interest for intelligence agencies. Data scientists and hackers will be as important to intelligence agencies from now on as old-fashioned spies.

Big data, bigger brother: The rise of James Bond, data scientist – ZDNet

Hadoop

10 FOLD ICON 15x15 Technavios market research analysts predict the Global Hadoop Market to grow at a CAGR of more than 53% over the next four years. Several factors such as data explosion in enterprises and demand for cost-effective solutions to meet big data analytics needs contribute to the growth of this market. However, the market is witnessing a lack of trained and talented technical experts. Companies are unaware of the technologies concerned and skills required for managing big data. As per the forecast, this market will witness a gradual shift towards Software as a Service (SaaS)-based Hadoop solutions as it helps enterprises save cost and gain a better user experience.

Breaking News Of Global Hadoop-As-A-Service(HDaaS) Market to grow at a CAGR of more than 53% From 2015-2019 – openPR

IoT

10 FOLD ICON 15x15 Dell is teaming up with a number of companies for what it calls its “IoT Partner Solutions Program”. Those involved, at least initially, are GE, Microsoft, OSIsoft, PTC, SAP and Software AG. “The program builds an ecosystem of partners to help customers navigate the fragmented IoT landscape and identify the right technologies to develop their IoT solutions”, Dell announces. There’s a lot involved in this — Dell claims it will combine its network of Independent software vendors along with the company’s range of IoT assets like intelligent gateways and embedded PCs, security and manageability tools, data center and cloud infrastructure, and data integration and analytics software. Dell is also working with Microsoft and Blue Pillar on solutions for the power grid, a seemingly endless vector for presumed attack, at least if you believe the media hype. Dell claims that “Additional partners are adding tremendous value through their specialized areas of expertise, including Azeti, Blue Pillar, Datawatch, Eigen Innovations, Flowthings, Flutura, GE, Kepware, Lynx Software, Microsoft Azure, OSIsoft, Relayr, SAP, Software AG, and ThingWorx”.

Dell teams with Microsoft and others to launch IoT Partner Solutions Program – BetaNews

eCommerce

10 FOLD ICON 15x15 MThe world of eCommerce is blowing up in the UK and the online retail industry is expected to grow by 10.5% this year and reach 173.7B euros. Today, the eCommerce Foundation released a study that shows over 43M Brits shopped online last year, of which 20% used a mobile device and on average British online shoppers sent 3,653 euros.

Ecommerce in the UK to reach 174 Billion in 2016 – eCommerce news UK

 

10Fold – Big Data Business Insights – 44

Big Data

10 FOLD ICON 15x15 According to Forbes, data has a lot of enemies – and the largest group of opponents might just be those of who have simply been forced fed too much media spin on the subject in the first place. The term Big Data has arisen to be defined as an amount of data that will not practically fit into a standard (relational) database for analysis and processing caused by the huge volumes of data created by IoT as well as machine-generated and transactional processes. Some of the enemies of Big Data include – IT architecture, amateur data science, resources (resources that are able to analyze data, draw conclusions and help organizations make better business decisions based on the data), and culture – which are the ways an organization makes  decisions based on what has previously been done successfully, or unsuccessfully.

10 FOLD ICON 15x15  What is Big Data? Like most in tech, it depends on your perspective. Big data is data that’s too big for traditional data management to handle. ZDnet describes Big Data in three V’s: volume, velocity, and variety: these three vectors describe how Big Data is so very different from old school data management. Volume is the V most associated with Big Data because, well, volume can be big. Velocity is the measure of how fast the data is coming in.  For example, Facebook has to handle a tsunami of photographs every day. It has to ingest it all, process it, file it, and somehow, later, be able to retrieve it. The variety depends on the type of data coming in. For example, email messages. A legal discovery process might require sifting through thousands to millions of email messages in a collection. Not one of those messages is going to be exactly like another. Each one will consist of a sender’s email address, a destination, plus a time. The three V’s describe the data to be analyzed. Analytics is the process of deriving value from that data.

The Seven Enemies of Big Data – Forbes

Volume, velocity, and variety: Understanding the three V’s of Big Data  – ZDNet

Hadoop

10 FOLD ICON 15x15 With Pivotal Software Inc.’s announcement that it is formally abandoning Hadoop development in favor of standardizing on Hortonworks Inc.’s platform, the field of active competitors in the Hadoop market has been culled to just a handful. With that as a backdrop, SiliconANGLE checked in with Mike Olson, who co-founded Cloudera, the first commercial Hadoop company, in 2008. Cloudera is considered the market leader in Hadoop-related platforms. With massive funding from Intel Capital and others, it’s well-positioned to see the market through to maturity.

Cloudera’s Olson sees innovation flourishing amid consolidation – siliconANGLE

IoT

10 FOLD ICON 15x15 Twin sisters and social entrepreneurs America and Penelope Lopez, are taking up the fight against one of the most revolting crimes on the planet—human trafficking with their Beacon of Hope IoT app. It is the latest in the string of hackathon successes that includes an anti-bullying app and a police body cam with facial recognition. In volume, the cost to set it up would be negligible, and data from Google and Palantir could be used for targeted placement along human trafficking trade routes. Central to the design is a single fact revealed from former victims: the only time victims are away from their captors and alone is when they enter a public bathroom. After a victim acquired a tracker, they would squeeze it to turn it on, broadcasting its unique identifier, which volunteers’ smartphones would pick up and relay to law enforcement and victim assistance non-governmental organizations (NGOs). A rapid response might free the victim.The Lopez sisters will also use the Amazon Dash button as a Button of Hope. Originally designed for reordering products, it has a microcontroller and a Wi-Fi and Bluetooth radio with an AAA battery that is programmed to do just one thing: send a unique identifier over the network to Amazon to order staples such as laundry detergent. Installed in a public restroom, the button would be repurposed to send a signal over the local Wi-Fi network to law enforcement that a victim has temporary sanctuary at a known location.

Using the IoT for good: Beacon of Hope project to help fight human trafficking – Network World

Personalization

10 FOLD ICON 15x15 MediaPost offers a great example of how the concept of personalized marketing has changed over time. 30 years back, a personalized shopping experience would be a family going to a meat market and the butcher knowing the family by face and asking how they are and giving them deals and that in turn makes the family a life time and loyal customer. Today,  marketers are harnessing data because they’re trying to create relationships that are as effective as a local family’s butcher. Targeting and personalization are crucial reasons why more dollars are being spent online than anywhere else, that being said, marketers are in need to find more strategic ways to reach and maintain their loyal customers.

Personalization vs. Personal relationships – MediaPost

OpenStack

10 FOLD ICON 15x15 Red Hat made it clear a few years ago that it couldn’t rely on its Red Hat Enterprise Linux (RHEL) glory forever. It needed a path to transformation and it saw a way with OpenStack and the hybrid cloud. Today it continued its steady march toward fulfilling that cloudy vision with the release of OpenStack Platform 8 and the Red Hat Cloud Suite. The cloud suite offers an integrated package with cloud, DevOps and container tools in a single solution with the kind of management layer you would expect in such a suite. It combines Red Hat OpenStack with Red Hat OpenShift, its container environment and CloudForms for overall management and the ability to add self-service in a private cloud setting. The idea is to provide an integrated package, but recognizing not everyone will want to get the entire solution from one company, it will also offer the pieces individually and work with other offerings.

Red hat continues cloud transformation with new OpenStack and Cloud Platform Suite products – TechCrunch

10Fold – Big Data Business Insights – 38

Your daily digest of “All Things Big Data” gathered, collected and researched by your very own 10Fold Big Data Practice team.

Big Data

10 FOLD ICON 15x15 Data scientists are in high demand, and at the same time they are in short supply. This is due to data science being a relatively new field, and universities are only just starting their own programs to train up a new generation of big data experts. Because of this high demand, good data scientists command high salaries, and bringing a full time data scientist on at a small business with a low budget simply isn’t a choice. However, there has been a shift to using freelance data scientist. Instead of hiring full time data science professionals to oversee all big data projects within an organization, the company instead hires on a per project basis. This is especially important for smaller businesses, since the time between big data projects at that level can often be lengthy. Passing over the full time option means a business wouldn’t have to worry about paying a big data expert when they have nothing for them to do. This added flexibility also leads to choosing data experts based off of their individual talents. For example, if a big data project requires hiring a data scientist with expertise in sales, the small business can do so. Their fees aren’t based off of a salary but rather on the milestones reached in the project.

10 FOLD ICON 15x15  According to VentureBeat, Attivio raised $31 million to help companies make sense of big data.  The Massachusetts-based startup promises to “accelerate data discovery,” which they announced today when they closed the $31 million deal. The investment will help the company meet investors’ expectation of turning profitable “later this year.” Oak Investment Partners invested in Attivio and had this to say, “Our increased investment underscores our belief that Attivio has game-changing capabilities for enterprises that have yet to unlock the full value of Big Data.” This is a big year for Attivio, who also highlighted such recent business victories as landing lab equipment maker Thermo Fisher Scientific as a client and partnering with medical informatics shop PerkinElmer.

The Benefits of Hiring Freelance Big Data Experts – Smart Data Collective

Attivio Raises $31 Million to Help Companies Make Sense of Big Data – VentureBeat

Hadoop

10 FOLD ICON 15x15The global Hadoop market is expected to grow at a CAGR of more than 53% over the next four years. Several factors such as data explosion in enterprises and demand for cost-effective solutions to meet big data analytics needs contribute to the growth of this market. However, the market is witnessing a lack of trained and talented technical experts. Companies are unaware of the technologies concerned and skills required for managing big data. As per the forecast, this market will witness a gradual shift towards Software as a Service (SaaS)-based Hadoop solutions as it helps enterprises save cost and gain a better user experience.

Global Hadoop Market 2015 – Industry Analysis, Shares, Size, Research, and Forecast to 2019 – Digital Journal

 

IoT

10 FOLD ICON 15x15 IoT is progressively gaining momentum throughout the Middle East and Africa (MEA). This is helping the Middle East due to the continuous drop in oil prices, which is causing governments and businesses to cut their spending budgets. Despite these new restrictions, MEA governments and businesses are looking to diversify their investments into long-term smart technology initiatives that will help enhance their competitive advantage and improve their levels of customer satisfaction. This objective has meant that IoT spending has been largely resilient to the growing budget cuts currently sweeping across other areas of the economy.

10 FOLD ICON 15x15 Consequently, a number of countries in the MEA region are being challenged to meet growing demands for power in order to facilitate the expansion of various business sectors. At the same time, the advocacy surrounding sustainable and clean energy today is spurring growth in smart utilities investments. As a result, the country is seeing an increase in the deployment of so-called Smart Grids (both for electricity and gas) due to the energy management improvements that they provide. Such investments will see IoT spending related to utilities in MEA increase 14 percent year over year in 2016 to total $647.94 million.

10 FOLD ICON 15x15 According to “The Future is Connected” report from SITA – the leading global IT provider to the air transport industry – 83 percent of air travel passengers have smartphones, which allows the unifying technology to provide a connected end-to-end experience. “Half of airlines expect to have IoT initiatives up and running over the next three years. Meanwhile, airports are building the infrastructure to support IoT. Together, this will deliver improved operations and will lead to a change in the passengers’ experience,” said Nigel Pickford, director Market Insight, SITA. Smartphones are reshaping travel behavior and with growth rates of around 80 percent or more at the check-in and boarding pass stages, it is clear that air travelers are keen to use this unifying technology.

10 FOLD ICON 15x15 According to The Economist, sensor-filled “beans,” developed by Andrew Holland, an electronics engineer from Swaffham Bulbeck, could provide an answer to many a farmer’s prayers. Mixed into the contents of the beans are sensors that help report continuously on the temperature and humidity (both of which encourage rotting if they are too high) and on carbon-dioxide levels, which reflect the amount of insect breath exhaled, and thus the level of infestation. If the beans do well at monitoring grain, Holland hopes their other applications will make them an important part of the much-discussed IoT. Ultimately, some believe these beans will help link many things (such as food crops) not currently connected electronically.

‘Internet of Things’ to Transform Air Travel Experience Globally: Report – Zee News India

Cool Beans – The Economist

IIoT

10 FOLD ICON 15x15 Bosch is working together with partners to combine the technical standards of Germany’s “Industrie 4.0” platform and of the Industrial Internet Consortium (IIC) for the first time. This is concerning many people, because if all the energy-intensive machinery in Bosch’s Homburg plant runs at the same time, it can potentially lead to very high electricity consumption at peak times. As a result,the increase in electricity pushes up the cost of manufacturing the hydraulic valves. By using software to manage production and electricity consumption as effectively as possible, energy demand can be optimized and peak loads reduced by up to ten percent. The partners combine their expertise to optimize energy consumption at the plant. Bosch continuously collects data from all the machinery in the plant, generating a stream of information about the electricity consumed in the process of manufacturing the hydraulic valves for agricultural machinery.

Bosch combines “Industrie 4.0” platform and Industrial Internet Consortium standards for the first time – Automotive World

eCommerce

10 FOLD ICON 15x15UK-based, B2B ecommerce software company, On Demand Solutions,  has now launched an ecommerce software solution for B2C retailers. The new solution focuses especially on small and medium-sized companies, and has omni-channel functionality. Additional features allow smaller ecommerce players a responsive online storefront, and ability to control multiple webstores through one CMS, enabling clients to sell their products through multiple marketplaces. Features of these webstores include social media links, intergration with MailChimp, product reviews, vouchers, best-selling items and integration with Google Adwords, Amazon and Ebay. It also integrates with ERP back office software including SAP Enterprise, SAP Business One, Sage 200, Sage 1000 and Astute.

ODSNet launches B2C ecommerce software solution – Ecommerce News UK

Software Defined Networks

10 FOLD ICON 15x15 Yesterday, Microsoft announced it is giving away free software it designed for its own internal use called Software for Open Networking in the Cloud (SONiC). SONiC is software used to run software defined networking,  which threatens to overturn Cisco’s stranglehold on the network switch industry. SDN takes features that an expensive switch offers and puts them into software, making networks easier to program, update and change. Microsoft is giving SONiC software away as part of its work with the Open Compute Project (OCP), an organization founded by Facebook to build open source hardware for data centers the same way that the people behind the Linux operating system do with free, open source software. The two big companies that are not working with SONiC are VMware and Cisco – which could mean trouble for them in the future.

Microsoft just joined Facebook and fired a huge shot at Cisco – Business Insider

10Fold – Big Data Business Insights – 33

Your daily digest of “All Things Big Data” gathered, collected and researched by your very own 10Fold Big Data Practice team.

Big Data

10 FOLD ICON 15x15 Big Data is transforming the way we view medicine by means of clinical trials and studies. Clinical trials work by testing how well a treatment works and identifying any side effects. However, these trials require participants who meet rigorous scientific standards. This is where big data can help. By mining the world of practice-based clinical data — actual patient records — for information on who has what condition and what treatments are working, doctors could learn a lot about the way they care for individuals. Many different companies are searching for a way to enable healthcare providers to learn from practice-based evidence to individually tailor care. Electronic Health Records have been around for a while but with data stored across a number of different  systems and formats, they are not designed with analysis in mind. A future which combines both evidence based and practice based medicine is likely to produce the best outcome for patients.

10 FOLD ICON 15x15  Women in tech have always been outnumbered by men, but this disproportion could be encouraging more females to enter the tech workforce. According to CNET, less than 17% of the tech industry is made up of women. Recently, Big Data and statistic fields have been attracting a surprising amount of females. It’s been noted that women are achieving more than 40% of statistic degrees, and new career paths in data science now hold multiple opportunities for women. The rise of women in the world of data could also be due to the belief that women typically excel in communication and problem solving, two main areas that are required for data-oriented roles.

How Big Data is transforming medicine – Forbes

Are Big Data Career Paths Attracting More Women to Tech? – Huffington Post

Hadoop

10 FOLD ICON 15x15 Hadoop has grown to two significant phases of maturity, defined by how companies first used it and what tools emerged to create a vibrant ecosystem in the process. When it became clear that Hadoop has the ability to provide real business value, many departments started building workloads for business intelligence and reporting to extract meaningful insights. Hadoop is currently in its third phase within enterprise environments. We’re starting to see multi-department uses within organizations. It also comes with a whole new set of requirements that Hadoop has not considered prior. Applications don’t exist yet that will run on Hadoop but it is predicted that will be in the future.

The Phases of Hadoop Maturity: Where Exactly Is it Going? – Data Informed

 

Docker/ Containerization

10 FOLD ICON 15x15 Containers are all the rage among developers, who use the open source software to build, test and run applications. The technology offered by companies such as Docker are not on the radar of most Fortune 500 CIOs, suggesting that it has a ways to go before it gains traction in large enterprises. Most CIOs are unfamiliar with abstract technology and express skepticism. Some of the comments from a live audience poll conducted at a recent Wall Street Journal event indicate that some CIOs believe that the VMs running their private or hybrid clouds are sufficient.

CIOs aren’t ready for Docker and container technology – CIO

IoT

10 FOLD ICON 15x15  Among smart watches, smart appliances, smart homes, and smart buildings come smart cities. The market for smart cities is expected to grow from $52 billion last year to $148 billion by 2020. More than 200 smart city projects are underway around the world, fueling the demand for products and services from IoT vendors, service providers, and platform companies and consultants. North America is expected to dominate the IoT in smart cities over the next several years.

10 FOLD ICON 15x15 IBM just launched a tool called Quark for IoT development. Quark is based on IBM Streams, a product for processing large amounts of live data. Quark is just beginning, although IBM is hoping that by making it open source the community will catch on and help with its development. IBM has an existing suite of tools and services useful for the IoT – such as Watson – but it’s clear the company plans to continue its leadership and won’t slow down progress as competitors like Cisco bolster their own enterprise-level IoT solutions.

IoT Smart Cities Market Heading to $148 Billion – Media Post

IBM launches Quark tool for IoT development – Developer Tech

eCommerce

10 FOLD ICON 15x15 In the last decade, the amount of people shopping online has exploded. The US alone was responsible for 31.7% of global e-commerce sales in 2015. Forbes looked at the their predictions for the trending eCommerce products for 2016 and beyond and decided major tips and tools for launching eCommerce businesses. These include: consumer behavior research, product research, and product ideation.

10 FOLD ICON 15x15 Several articles covered Indian eCommerce company, Snapdeal’s $200 million in new funding, led by Ontario Teachers’ Pension Plan, the Canadian investment vehicle with over $150 billion in assets. The new investment puts Snapdeal’s valuation in the $6.5-$7 billion range, making it the second most valuable startup in India, after Flipkart. Snapdeal says that the capital raised will be used to further build out its technology platform, logistics, payments, and back-end infrastructure.

10 FOLD ICON 15x15 Business to Community recommended 9 ways to get the ABCs of eCommerce right. They are 1) analytics, 2) behavior analysis, 3) customer service, 4) discounts and offers, 5) eCommerce platform, 6) feedback and testimonials, 7) gateway (payments), 8) hacking and security, and 9) inventory management.

Tips and Tools for Launching Your eCommerce Business – Forbes

India’s Snapdeal raises $200 million to challenge Amazon and Flipkart – VentureBeat

Snapdeal raises $200M more to fuel up for India’s ongoing e-Commerce battle – TechCrunch

9 Tools to Get the ABCs of eCommerce Right – Business2Community

Openstack

10 FOLD ICON 15x15 Rackspace has announced a new OpenStack-as-a-Service option in partnership with Red Hat, whose enterprise Linux distribution powers the new cloud platform. The platform is a hosted implementation of Red Hat Enterprise Linux OpenStack Platform, Red Hat’s main product for building open source private and hybrid clouds using OpenStack. While Red Hat’s OpenStack distribution has been available for more than two years, the Rackspace hosted offering provides another way for enterprises to deploy OpenStack as a service rather than a platform they maintain themselves. Rackspace says this is important as a way to speed OpenStack adoption.

Rackspace adds hosted Red Hat OpenStack to Cloud Services – The Var Guy

10Fold – Big Data Business Insights – 31

Your daily digest of “All Things Big Data” gathered, collected and researched by your very own 10Fold Big Data Practice team.

Big Data

10 FOLD ICON 15x15 To finance big data initiatives, businesses need to invest in tools or services such as software or malware. Companies may also need to invest in new staff members which can increase costs dramatically. In order to maximize big data needs on a budget, Huffington Post recommends organizations think about the strategic objectives and the insight they’re looking for from big data, make use of the resources they already have (such as data sources, data storage, data analysis and data output), look for savings on software, and take advantage of big data as a service (BDaaS) with cloud-based services.

How to do Big Data on a budget – Huffington Post

Hadoop

10 FOLD ICON 15x15 Hadoop is in high demand according to the latest earnings report from Hortonworks Inc. Hortonworks is the only Apache Hadoop distribution company that is publicly traded. Its Hadoop distribution competitors, Cloudera and MapR, are both venture-funded companies that don’t publish financial results. Hortonworks’s earnings report comes a week after big data visualization company Tableau spooked Wall Street investors with its quarterly results, which showed significant growth yet disappointed analysts on one key performance indicator — setting off the negative market reaction.

Hadoop Vendor Hortonworks Triples Revenue in Q4 – SiliconANGLE

IoT

10 FOLD ICON 15x15 U.S. Director of national intelligence, James Clapper, said in a statement to the Senate on Tuesdays that intelligence services may use the wide array of IoT devices for identification, surveillance, monitoring, location tracking, and targeting for recruitment, or to gain access to networks or use credentials. However, a recent study from the Berkman Center for Internet and Society claims these same intelligence agencies could also use IoT devices to illuminate an environment that was previously viewed as “going dark” due to new forms of encryption being used in consumer products and services.

10 FOLD ICON 15x15 Microsoft’s partnership with HCL Technologies for an Incubation center is hot topic again this week. Microsoft is working with HCL Technologies to drive enterprise adoption of the IoT by leveraging the Azure IoT Suite. The idea is to use real-time analytics, sensory data, and rapid collaboration to let customers see how IoT can affect their business value.

We might use your IoT stuff to spy on you – Naked Security

Microsoft, HCL Partner for IoT Incubation Center – Informationweek

eCommerce

10 FOLD ICON 15x15 B2B buyers are looking for an eCommerce experience that is comparable to buying consumer goods. B2B buyers often make purchases on B2C websites when products are available, so the opportunity to sell to businesses exists for B2C online merchants. Reasons for switching to online purchasing include the convenience of being able to purchase 24 hours a day and the speed of completing the transaction.To make the B2B sale, ecommerce merchants should provide the following:

  • Publish detailed relevant content and make sure it is easily accessible for the prospective buyer in all sales channels
  • Use graphics and video to showcase products
  • Include a live chat feature in case the buyer needs more information — this is more appealing to many buyers than having to talk to a salesperson
  • Use tracking, monitoring, and measurement tools. Analyzing buyer behavior can predict conversion as well as repeat purchases and help to make any necessary changes to the buying process.

How to Attract B2B Buyers to Ecommerce – Practical eCommerce

OpenStack

10 FOLD ICON 15x15 Today Rackspace announced that it has been certified by Red Hat to manage Red hat OpenStack deployments in data centers. This will allows organizations to deploy OpenStack cloud platforms on-premises around Red Hat’s brand of Enterprise Linux, and hire Rackspace to manage them. However, there is a challenge with this partnership, as anyone selling OpenStack private clouds to enterprises will require a massive install base of VMware and Microsoft software in enterprise data centers.

Rackspace Continues its Quest to Support Everyone Else’s Cloud – Barb Darrow

Rackspace to Manage Red Hat OpenStack Clouds On-Premises – CMS Wire

Rackspace Debuts Red Hat OpenStack For Private Clouds – CRN

What’s Behind Rackspace’s Private OpenStack Cloud – Data Center Knowledge

10Fold – Big Data Business Insights – 28

Your daily digest of “All Things Big Data” gathered, collected and researched by your very own 10Fold Big Data Practice team.

Big Data

10 FOLD ICON 15x15 In InformationWeek’s weekly Big Data roundup,  articles surrounding how sensors, tablet devices, and other technologies are helping sports teams uncover insights that can improve their performance on the field. Also included was Tableau’s big scare from its 50% drop in stock on Friday, as well as big drops of other digital companies, including Salesforce, Workday and LinkedIn.The Wall Street Journal called the market’s reaction to Tableau and LinkedIn’s earnings as a “bloodbath,” quoting one analyst as saying that Tableau’s results and guidance delivered a “major gut punch” to investors.

10 FOLD ICON 15x15 The BBC examines how big data is being used to save lives, noting that  experts estimate ninety percent of the data in the world has been created in the past two years alone,   thanks to technological innovation. As technology has advanced, so too have the opportunities for scientists. The more genomes are analysed, the greater the hope of new and more effective treatments for rare diseases. In the US, President Obama recently launched a Precision Medicine Initiative which plans to gather big data to develop more individualized care. In China, a study of 500,000 people is doing something similar which will make it possible to compare and contrast the health of entire populations in the not too distant future.

Super Bowl 50 Gets Analyzed, Tableau Spooks Investors: Big Data Roundup – InformationWeek

The challenge of saving lives with ‘big data’ – BBC

Hadoop

10 FOLD ICON 15x15  Since many companies are discovering that getting Hadoop’s cluster to run optimally is a daunting task, they are also taking initiative to ensure that their clusters are running smoothly and efficiently. Dataconomy highlights three warning signs to note to ensure clusters are operating at the highest capacity. First, if there isn’t enough capacity, trace your issues back to the YARN architecture. Second, if your high-priority jobs aren’t finishing on time, check your parameters or configuration settings… Lastly, if a cluster grinds to halt periodically,  it could be a big concern. Isolate the cause of the problem using traditional node-monitoring tools.

Smoke Signals Coming from your Hadoop Cluster – Dataconomy

IoT

10 FOLD ICON 15x15 Many large technology firms such as Intel, IBM, Microsoft, Google, and Cisco have all been vying for top positions when it comes to IoT thought leadership. Mike Krell of Moor Insights and Strategy claims Cisco Systems is currently leading the pack. Cisco had a robust 2015, initiating or completing 11 acquisitions. Granted not all of these were “IoT centric”, but many of them began to fill holes in Cisco Systems’ IoT strategy. Cisco began 2016 with two new deals with SK Telecom and Jasper Technologies. The SK Telecom deal extends Cisco Systems’ IoT reach in yet another region, as well as working with a solution that has been demonstrated to be compatible with both oneM2M and Open Internet Consortium. Jasper Technologies has the ability to provide a significant IoT software platform that complements Cisco’s infrastructure hardware strengths.

10 FOLD ICON 15x15 CIO writes that although IoT is continuing to grow at a rapid pace, TEksystems Research reports some businesses lack confidence in its technology. Though a lot of businesses have invested in IoT,  very few have seen IoT impact the organization in a meaningful or measurable way. Businesses overall lack confidence in their ability to adapt quickly to new technology as well as demonstrate the benefits to executives. There is no denying the potential of IoT, yet many businesses have not figured out how to achieve success with this potential quite yet.

10 FOLD ICON 15x15 CRN published its 10 IoT predictions for 2016. Some predictions include an increase in connected devices. According to Gartner, there will be 6.4 billion connected “things” in use in 2016. Another prediction alluded that Intel will remain at the IoT Forefront. During CES, Intel showed off its smart helmet and smart dress that contained its IoT-focused Curie modules. But they recently revealed that they have even more products up their sleeve for 2016 as they are announced partnerships with SATO, and RetailNext to form a Retail Sensor Platform which will bring IoT into the retail vertical. Other predictions highlight increased consolidation of IoT companies, security breaches on the IoT front will increase caution for IoT game players, and a new WiFi standard will emerge specifically for IoT devices.

10 FOLD ICON 15x15 India based global services company HCL Technologies has launched an Internet of Things incubation center in Redmond, WA, the home of Microsoft. Both vendors will use Microsoft Azure IoT Suite to create apps for industry and manufacturing and the Life Sciences and Healthcare sector. The incubation center will aim to combine HCL’s skills in engineering and product lifecycle management, systems integration and infrastructure services with Microsoft’s leadership in IoT.

Is Cisco Systems The One To Beat In Industrial IoT? – Forbes

Business leaders lack confidence in IoT technology – CIO

10 IoT Predictions for 2016 – CRN

HCL and Microsoft launch IoT incubation centre – BCN

Cognitive Computing

10 FOLD ICON 15x15 In the UK, a four-year project leveraging big data analytics technologies is bringing together leading British Universities, government agencies, and big pharma companies (Pfizer, GlaxoSmithKline, etc.) to develop a digital design technique to streamline development and manufacturing of meds, enhance predictive processes and give patients faster access to the drugs they need.

UK Using Cognitive Computing in Personalized Medicine Push – Enterprise Tech

eCommerce

10 FOLD ICON 15x15 India’s largest restaurant search and food delivery startup, Zomato, announced early this week that it has broken even in several big markets – including India – and will hit profitability by mid-2016. When it does so, Zomato will be the first Indian e-commerce unicorn to become profitable, a significant milestone in a market where Indian startups are finding it quite challenging to lure investors for subsequent rounds because none of them are close to profitability. Zomato’s financial announcement is significant as global investors have poured billions of dollars in venture capital into Indian startups in the last couple of years. Zomato’s healthy financials can mostly be attributed to the fact that the startup does not spend on either marketing or customer acquisitions, unlike other Indian unicorns Flipkart, Snapdeal and Paytm.

10 FOLD ICON 15x15 CIO commented on eCommerce predictions they believe will take place during 2016. Some examples include: an increase in demand for in-house teams to drive optimization strategies and digital marketing experiences; content and commerce will continue to blend through branded content and informative guides;and customer experience will reign as retailers continue to personalize and tailor their products to their users through search technologies and behavior studies.

Food Startup Zomato Is India’s First Ecommerce Unicorn To Break Even, Headed for Profitability – Forbes

More eCommerce predictions for 2016 – CIO

Personalization 

10 FOLD ICON 15x15 Marketers believe 2016 is the year for personalization. According to VentureBeat’s Insight report, 257 of the email marketers surveyed showed increased open rates and click-through rates by employing some form of personalization.

Email personalization: Increase open rates by 500% (webinar) – VentureBeat

Software Defined Networks

10 FOLD ICON 15x15 Hybrid cloud and DevOps software-defined networking are considered the best supporting approaches to making cloud services succeed. A recent survey by F5 Networks explored the connection between cloud implementations and DevOps, and found that survey respondents seem to associate DevOps more with private cloud. The survey also found that both SDN and DevOps are key to IT’s ability to improve operational efficiency.

Enterprise cloud performs best with DevOps, software-defined networks – ZD Net