Tag Archives: Hadoop

Big Data Horizons- MoviePass, Top 4 Data Skills

MoviePass Is Trying to Disrupt Hollywood — Will It Succeed?

“Will revolutionize the way we go to movies”

With a fleeting business model and a growing loss of revenue, MoviePass is looking to revamp consumer interest in theater viewing. The idea is predicated on the Netflix model, which allows users to stream unlimited media on a subscription basis as opposed to per title. MoviePass similarly operates by allowing users to buy a subscription program, hoping to provide a more frequent and consistent movie viewing audience. The firm is expected to make an IPO in early 2018, and showcases another application of big data in entertainment.

Top 4 Big Data Skills for Engineers

“The Big 4 demanded by consumers and employers”

Administer

The physical infrastructure forms the backbone of a Big Data implementation. This infrastructure needs careful planning and configuration to withstand data storage and processing demands. DevOps for Big Data is a key admin skill and often requires knowledge of cloud architectures as Big Data processing is extremely well-suited for the elastic and highly available nature of the cloud.

Develop

These are the skills that have proven essential for building data pipelines and frameworks that ultimately provide data for the data scientists to analyze. Data pipelines are responsible for ingesting data from a variety of sources, including real-time and batch. Hadoop and Spark are the most popular Big Data frameworks used across organizations. While Hadoop is the popular choice to store Big Data, Spark has stepped in to provide a lightning fast framework to process data.

Analyze

This encompasses a mix of expertise in statistics, machine learning, data mining, operations research, mathematics, and computer programming. Data scientists, data analysts, machine learning engineers, and artificial intelligence engineers are required to dive into petabytes of messy data, build algorithms, and then write robust code to automate the algorithms and prove their performance on large-scale live data. In addition to familiarity with the Hadoop ecosystem, this role also demands experience with programming languages like R, Java, Scala, and Python.

Visualize

Visualization developers tell a story using the data collected and design dashboard visualizations tailored to customer needs. These people serve as a technical resource for accessing disparate sources of data and integrating these sources into a common and interactive platform that effectively displays how the company’s data meets their Key Performance Indicators (KPI).

Lenovo drives big data take up in car making industry

“Partnership to promote AI in auto industry”

Announced last Wednesday, Lenovo is set to examine Haima’s sales data to bring solutions in targeting potential customers.  The collaboration will eventually encompass more areas of development, in areas such as car design, development, and smart manufacturing. This deal is one of many since Lenovo has started to provide solutions to clients in 2016. Various industries including metallurgy and medicine have benefited from Lenovo’s big data arm.

Enjoy your read? Check out our other content here.

Big Data Horizons- HiQ Labs and LinkedIn, Asian Pacific Trend

We have a US $65B big data opportunity in Asia Pacific, and the trends point to big benefits

“Global Big Data market growing fast”

Market intelligence firm IDC has stated that the worldwide big data market cap is expected to hit $203 billion in the near future, with the Asian Pacific (APAC) leading much of the growth. IDC claims that organizations investing in productivity benefits in the region could attain $65 billion in reward by 2020 over competitors. Further, 53% recognize the necessity of big data for business and that they currently do, or will rely on it for their market survival in the future.

Imanis Data focuses on big data backup and recovery

“Necessary, as three of four firms has suffered data loss in the last year”

Imanis Data, formerly Talena, has released eponymous backup and recovery platform version 3.0, which emphasizes support for large datasets generated by companies on the new era of big data.

Version 3.0 is claimed to strengthen backup architecture, recover and replicate terabyte and petabyte-sized data sets up to 10 times faster than any other solution on the market, and minimize the impact of data loss by reducing costly days and weeks of downtime to minutes and hours and reducing secondary storage costs by almost 80%.

The company has also claimed that its data backup platform utilizes cloud-based data replication to provide backup and disaster recovery across different regions and providers. This will essentially allow a user to split their backup across Microsoft Azure Blob Storage and HDInsight, while also including Amazon S3 and the Hortonworks cloud distribution for Hadoop.

Judge orders LinkedIn to unblock startup from scraping public profile data: Report

“Ordered to unblock HiQ Labs from scraping public data”

U.S. Judge Edward Chen has has ruled that LinkedIn must allow the talent management startup HiQ Labs from collecting profile data from users within 24 hours on Monday.

HiQ Labs responded to the verdict on Monday “This ruling allows us to continue serving our clients while we seek to permanently prevent LinkedIn from monopolizing the aggregation and analysis of publicly available information on the web,”

LinkedIn had first confronted HiQ in May with a letter asking them to cease data collection of LinkedIn profiles for their business practices which uses publicly available “people data” to train its AI models to predict employee behavior.

Judge Chen, in his ruling on Monday, claims that adopting LinkedIn’s “broad interpretation” of CFAA “could profoundly impact open access to the internet, a result that Congress could not have intended when it enacted the CFAA over three decades ago.”

Enjoy your read? Check out our other content here.

3 Insights from Industry Leaders at 10Fold’s Inaugural Big Data Horizon Event

With 10Fold’s first ever Big Data Horizon (BDH) event coming to a close last week, we’re sharing some of the key takeaways on what industry leaders are focusing on as they build their data strategies.

  • Big Data & Big Legal

With the ever-increasing complexity of data collection and a growing number of embedded sensors in the products used by enterprises, legal’s role in safeguarding such data was top of mind at BDH. George Gilbert, Lead Analyst for Big Data & Analytics at Wikibon, noted that technologies like “digital twins”, which provide the entire lifecycle data for products, will have far-reaching legal ramifications. Digital twin technology will likely raise unique challenges for enterprises that outsource data collection and analysis, as they will have to contend with new issues in data ownership and potential leakages.

  • No More “Machine Learning”?

Big Data as an industry is rife with buzzwords, fads, and controversy. Often concepts in data science take on several name changes as technologies are either innovated upon or fade away in deference to competing technologies. Just as the term “perceptron” fell to neural networks, many participants at the BDH did not believe that “machine learning” would last as a phrase in the Big Data lexicon.

  • Enabling Citizen Data Scientists

Software will increasingly take up a larger share of the pie with hardware and infrastructure maturing as market segments. These shifts will eventually translate into a greater number of power users and citizen data scientists taking on some of the less specialized aspects of data science, with many new tools emerging to cater to this audience. If this trend continues, employers will increasingly look for people who have an idea about data science fundamentals to bridge skill gaps as they look to apply data to business processes.

Are these trends in line with what you heard at Big Data Horizon, or if you weren’t able to make it to the event, have you been hearing similar things in your Big Data world? Let us know in the comments or on 10Fold’s Twitter, Facebook or LinkedIn.

And a huge thank you to all our first Big Data Horizon attendees. It would not have been a success without you, and we hope to see you all at the next Big Data Horizon event!

10Fold- Security Never Sleeps- 134

Attackers start wiping data from CouchDB and Hadoop databases

“Ransomware groups affect data storage firms”

The inevitable attack from ransomware organizations occurred over the last week, most recently with a data wipe from the databases of MongoDB and Elasticsearch clusters. Hadoop and CouchDB are also experiencing similar attacks.

New Mac malware uses ‘ancient’ code 

“New strain targets biomedical facilities with OS X”

An antiquated strain of malware ‘Quimitchin’ has been discovered by Malwarebytes after unusual outgoing traffic from an outdated Mac operating system was spotted by an IT admin. The research team commented that “in existence, undetected, for some time.”

Billion-dollar Hacker Gang Abuses Google Services To Control Malware

“Over $1 billion stolen from banks globally”

A new Forcepoint report indicates that operators of Carbanak have implemented a new system that allows the cyber-criminals to deliver commands to computers that have suffered from the infection. The infections often spreads through unprotected Google Spreadsheets and Google Forms.

Mobile Security Gap Threatens Enterprises

“New mobile tech causing security concerns”

Two new surveys of IT experts show that malicious software is on the hotlist for researchers. A Ponemon Institute study on behalf of IBM and Arxan found that nearly 84% of IT security practitioners believe that mobile applications are vulnerable to malware threats. IoT application researchers share the concerns at 66%, although at a lower rate.

Meet Our Client BlueData

Located in Santa Clara, California, BlueData simplifies Big Data deployment with its Epic™ platform that helps companies put the infrastructure in place to deploy Big Data apps that offer the insights and solutions their customers need. The Company is led by industry veteran Kumar Sreekanti, former Vice President of R&D at VMware and co-founder of Agami Systems.  Kumar is best known for his seminal work on real-time operating systems, file systems, software and hardware RAID solutions, both prior and during his time at BlueData.

BlueData collaborates with an impressive list of clients with big industry name recognition, including Comcast, AIG, and the United States Department of Homeland Security. BlueData has already won a hefty catalog of accolades, including a spot in the CRN 20 Coolest Platform and Tools Vendors and 2015 Stevie Award Winner: American Business Awards New Big Data ‘Software Product of the Year.’

Find some recent industry coverage of BlueData here, and learn more about BlueData’s product and services in this video:

Enjoy your read? Browse our other blogs as well!

10Fold – Big Data Business Insights – 46

Big Data

10 FOLD ICON 15x15 By 2020, businesses harnessing the power of Big Data should see $430 billion in productivity benefits over competitors not using data, according to International Institute for Analytics.  And today, most companies have the opportunity to bring Big Data to the bottom line. It is therefore not surprising that conversations about Big Data, data analytics and, more recently, cognitive analytics, are dominating corporate conversations. Data analytics finds useful information inside Big Data.  Insights can be descriptive, as when analyzing the percentage of bank customers who use online banking exclusively. Insights can be predictive, as when forecasting the percentage of banking customers who will be using online banking exclusively 10 years from now.  Or insights can be prescriptive, as when recommending whether a bank should expand its online presence or secure commercial space for additional branch offices. Cognitive analytics, a newcomer to Big Data discussion, draws on diverse dynamic learning tools, such as artificial intelligence and artificial neural networks. The horizon for new opportunity through data monetization is vast, as companies transform information collection and use to customer benefit and ultimately, profitability. Although data analytics can tell us the “what,” the “whether” and sometimes the “how to,” redefining data monetization as “leveraging data to generate value” informs corporate conversations with a clearer realization of the monetary value within Big Data.

10 FOLD ICON 15x15 According to Forbes, in 2013 the Journal of Business Logistics published a white paper calling for “crucial” research into the possible applications of Big Data within supply chain management. Since then, significant steps have been taken, and it now appears many of the concepts are being embraced wholeheartedly.Supply chain management is a field where Big Data and analytics have obvious applications. Until recently, however, businesses have been less quick to implement Big Data analytics in supply chain management than in other areas of operation such as marketing or manufacturing. Applications for analysis of unstructured data has already been found in inventory management, forecasting, and transportation logistics. In warehouses, digital cameras are routinely used to monitor stock levels and the messy, unstructured data provides alerts when restocking is needed. Forecasting takes this a step further – the same camera data can be fed through machine learning algorithms to teach an intelligent stock management system to predict when a resupply will be needed. Eventually, the theory is, warehouses and distribution centers will effectively run themselves with very little need for human interaction.

Finding the hidden monetary value of Big Data – The Tennessean

How Big Data And Analytics Are Transforming Supply Chain Management – Forbes

Hadoop

10 FOLD ICON 15x15 The big news in Big Data for the last 12 months has all been about real-time and streaming analytics. Spark, which became a top-level Apache project in 2014, has gained endorsements from every major Big Data player. A new player that’s been stirring up excitement is Apache Flink, a true stream processing engine whose developers recently landed $6 million in financing for their Flink-focused startup, Data Artisans. By 2026, 59 percent of all Big Data spending will be tied to Spark or related streaming analytics as enterprises seek to deploy applications that can make decisions on behalf of individuals. The reasons relate both to speed and simplicity. Hadoop introduced important concepts like moving analytics engines close to the data and incorporating unstructured data into a data lake, but it has developed incrementally into an ecosystem of more than 30 discrete components that can be daunting to coordinate. Spark has added real-time-like features through the Spark Streaming project, but it’s still fundamentally a “micro-batch” architecture for now, meaning that it simulates real-time analytics by processing small volumes of data quickly in batch mode. For most applications Spark is good enough, but true stream processing will demand a combination of Flink and Kafka unless Spark is able to evolve beyond its micro-batch approach by adding per-event streaming.

Spark muscling in on Hadoop’s territory, says Wikibon analyst – SiliconANGLE

IoT

10 FOLD ICON 15x15 Gizmodo reports that the state of Victoria is working with IT and communications companies to test out Narrowband-Internet of Things (NB-IoT) systems in its sewer and water systems. Huawei, Optus and Vodafone are partnering with the state agency South East Water for the trial in urban areas that include Melbourne. NB-IoT is a low-powered, low-cost radio technology that allows thousands of connected devices and infrastructure elements to gather and share data, regardless of the location. The three-month trial seeks to provide operators with access to granular, real-time data to better the safety, reliability and efficiency of Victoria’s sewer and water infrastructure. The trial will see NB-IoT sensors placed on sewer manhole covers to inform city workers of unauthorized access, to reduce the risk of injury and damage to water assets. NB-IoT technology will also be fitted to rainwater tank management systems to monitor storage levels amid efforts to optimize stormwater runoff and rainwater harvesting

IoT gets down and dirty in Australian smart sewers trial – ReadWrite

eCommerce

10 FOLD ICON 15x15 Neil Chandler, CEO of financial services at UK firm Shop Direct makes a statement that arguments reality and tactile technology will be the next change in online shopping. He states that Virtual reality (VR) and augmented reality (AR) are just one or two years away from changing the way consumers shop online. He gives the example that augmented reality would enable consumers to see how a sofa would look in their living room or how would they look in a piece of clothing.

Virtual Reality only two years away from being used in e-commerce industry, says Shop Director FS CEO- Computing UK

 

10Fold – Big Data Business Insights – 45

Big Data

10 FOLD ICON 15x15 Previously confidential documents have shed light on just how much data the UK’s intelligence services have been sifting through for over a decade. The types of data gathered by the intelligence services are wide ranging – Privacy International which revealed the documents said the agencies had the potential to requisition medical records and confidential information shared with a doctor, travel records, financial records, population data, commercial data, and feeds from internet and phone companies including billing data or subscriber details, content of communications and records from government departments. The agencies use this data to spot individuals of interest who might otherwise remain invisible. Following the Edward Snowden revelations, many tech companies improved protection for customer data flowing over the internet, making it hard for spies to tap in. And consumers are increasingly using end-to-end encrypted communications, which not even the companies providing the service can read, shutting out the spies again. As a result hacking and big data analytics will be big areas of interest for intelligence agencies. Data scientists and hackers will be as important to intelligence agencies from now on as old-fashioned spies.

Big data, bigger brother: The rise of James Bond, data scientist – ZDNet

Hadoop

10 FOLD ICON 15x15 Technavios market research analysts predict the Global Hadoop Market to grow at a CAGR of more than 53% over the next four years. Several factors such as data explosion in enterprises and demand for cost-effective solutions to meet big data analytics needs contribute to the growth of this market. However, the market is witnessing a lack of trained and talented technical experts. Companies are unaware of the technologies concerned and skills required for managing big data. As per the forecast, this market will witness a gradual shift towards Software as a Service (SaaS)-based Hadoop solutions as it helps enterprises save cost and gain a better user experience.

Breaking News Of Global Hadoop-As-A-Service(HDaaS) Market to grow at a CAGR of more than 53% From 2015-2019 – openPR

IoT

10 FOLD ICON 15x15 Dell is teaming up with a number of companies for what it calls its “IoT Partner Solutions Program”. Those involved, at least initially, are GE, Microsoft, OSIsoft, PTC, SAP and Software AG. “The program builds an ecosystem of partners to help customers navigate the fragmented IoT landscape and identify the right technologies to develop their IoT solutions”, Dell announces. There’s a lot involved in this — Dell claims it will combine its network of Independent software vendors along with the company’s range of IoT assets like intelligent gateways and embedded PCs, security and manageability tools, data center and cloud infrastructure, and data integration and analytics software. Dell is also working with Microsoft and Blue Pillar on solutions for the power grid, a seemingly endless vector for presumed attack, at least if you believe the media hype. Dell claims that “Additional partners are adding tremendous value through their specialized areas of expertise, including Azeti, Blue Pillar, Datawatch, Eigen Innovations, Flowthings, Flutura, GE, Kepware, Lynx Software, Microsoft Azure, OSIsoft, Relayr, SAP, Software AG, and ThingWorx”.

Dell teams with Microsoft and others to launch IoT Partner Solutions Program – BetaNews

eCommerce

10 FOLD ICON 15x15 MThe world of eCommerce is blowing up in the UK and the online retail industry is expected to grow by 10.5% this year and reach 173.7B euros. Today, the eCommerce Foundation released a study that shows over 43M Brits shopped online last year, of which 20% used a mobile device and on average British online shoppers sent 3,653 euros.

Ecommerce in the UK to reach 174 Billion in 2016 – eCommerce news UK

 

10Fold – Big Data Business Insights – 44

Big Data

10 FOLD ICON 15x15 According to Forbes, data has a lot of enemies – and the largest group of opponents might just be those of who have simply been forced fed too much media spin on the subject in the first place. The term Big Data has arisen to be defined as an amount of data that will not practically fit into a standard (relational) database for analysis and processing caused by the huge volumes of data created by IoT as well as machine-generated and transactional processes. Some of the enemies of Big Data include – IT architecture, amateur data science, resources (resources that are able to analyze data, draw conclusions and help organizations make better business decisions based on the data), and culture – which are the ways an organization makes  decisions based on what has previously been done successfully, or unsuccessfully.

10 FOLD ICON 15x15  What is Big Data? Like most in tech, it depends on your perspective. Big data is data that’s too big for traditional data management to handle. ZDnet describes Big Data in three V’s: volume, velocity, and variety: these three vectors describe how Big Data is so very different from old school data management. Volume is the V most associated with Big Data because, well, volume can be big. Velocity is the measure of how fast the data is coming in.  For example, Facebook has to handle a tsunami of photographs every day. It has to ingest it all, process it, file it, and somehow, later, be able to retrieve it. The variety depends on the type of data coming in. For example, email messages. A legal discovery process might require sifting through thousands to millions of email messages in a collection. Not one of those messages is going to be exactly like another. Each one will consist of a sender’s email address, a destination, plus a time. The three V’s describe the data to be analyzed. Analytics is the process of deriving value from that data.

The Seven Enemies of Big Data – Forbes

Volume, velocity, and variety: Understanding the three V’s of Big Data  – ZDNet

Hadoop

10 FOLD ICON 15x15 With Pivotal Software Inc.’s announcement that it is formally abandoning Hadoop development in favor of standardizing on Hortonworks Inc.’s platform, the field of active competitors in the Hadoop market has been culled to just a handful. With that as a backdrop, SiliconANGLE checked in with Mike Olson, who co-founded Cloudera, the first commercial Hadoop company, in 2008. Cloudera is considered the market leader in Hadoop-related platforms. With massive funding from Intel Capital and others, it’s well-positioned to see the market through to maturity.

Cloudera’s Olson sees innovation flourishing amid consolidation – siliconANGLE

IoT

10 FOLD ICON 15x15 Twin sisters and social entrepreneurs America and Penelope Lopez, are taking up the fight against one of the most revolting crimes on the planet—human trafficking with their Beacon of Hope IoT app. It is the latest in the string of hackathon successes that includes an anti-bullying app and a police body cam with facial recognition. In volume, the cost to set it up would be negligible, and data from Google and Palantir could be used for targeted placement along human trafficking trade routes. Central to the design is a single fact revealed from former victims: the only time victims are away from their captors and alone is when they enter a public bathroom. After a victim acquired a tracker, they would squeeze it to turn it on, broadcasting its unique identifier, which volunteers’ smartphones would pick up and relay to law enforcement and victim assistance non-governmental organizations (NGOs). A rapid response might free the victim.The Lopez sisters will also use the Amazon Dash button as a Button of Hope. Originally designed for reordering products, it has a microcontroller and a Wi-Fi and Bluetooth radio with an AAA battery that is programmed to do just one thing: send a unique identifier over the network to Amazon to order staples such as laundry detergent. Installed in a public restroom, the button would be repurposed to send a signal over the local Wi-Fi network to law enforcement that a victim has temporary sanctuary at a known location.

Using the IoT for good: Beacon of Hope project to help fight human trafficking – Network World

Personalization

10 FOLD ICON 15x15 MediaPost offers a great example of how the concept of personalized marketing has changed over time. 30 years back, a personalized shopping experience would be a family going to a meat market and the butcher knowing the family by face and asking how they are and giving them deals and that in turn makes the family a life time and loyal customer. Today,  marketers are harnessing data because they’re trying to create relationships that are as effective as a local family’s butcher. Targeting and personalization are crucial reasons why more dollars are being spent online than anywhere else, that being said, marketers are in need to find more strategic ways to reach and maintain their loyal customers.

Personalization vs. Personal relationships – MediaPost

OpenStack

10 FOLD ICON 15x15 Red Hat made it clear a few years ago that it couldn’t rely on its Red Hat Enterprise Linux (RHEL) glory forever. It needed a path to transformation and it saw a way with OpenStack and the hybrid cloud. Today it continued its steady march toward fulfilling that cloudy vision with the release of OpenStack Platform 8 and the Red Hat Cloud Suite. The cloud suite offers an integrated package with cloud, DevOps and container tools in a single solution with the kind of management layer you would expect in such a suite. It combines Red Hat OpenStack with Red Hat OpenShift, its container environment and CloudForms for overall management and the ability to add self-service in a private cloud setting. The idea is to provide an integrated package, but recognizing not everyone will want to get the entire solution from one company, it will also offer the pieces individually and work with other offerings.

Red hat continues cloud transformation with new OpenStack and Cloud Platform Suite products – TechCrunch

10Fold – Big Data Business Insights – 38

Your daily digest of “All Things Big Data” gathered, collected and researched by your very own 10Fold Big Data Practice team.

Big Data

10 FOLD ICON 15x15 Data scientists are in high demand, and at the same time they are in short supply. This is due to data science being a relatively new field, and universities are only just starting their own programs to train up a new generation of big data experts. Because of this high demand, good data scientists command high salaries, and bringing a full time data scientist on at a small business with a low budget simply isn’t a choice. However, there has been a shift to using freelance data scientist. Instead of hiring full time data science professionals to oversee all big data projects within an organization, the company instead hires on a per project basis. This is especially important for smaller businesses, since the time between big data projects at that level can often be lengthy. Passing over the full time option means a business wouldn’t have to worry about paying a big data expert when they have nothing for them to do. This added flexibility also leads to choosing data experts based off of their individual talents. For example, if a big data project requires hiring a data scientist with expertise in sales, the small business can do so. Their fees aren’t based off of a salary but rather on the milestones reached in the project.

10 FOLD ICON 15x15  According to VentureBeat, Attivio raised $31 million to help companies make sense of big data.  The Massachusetts-based startup promises to “accelerate data discovery,” which they announced today when they closed the $31 million deal. The investment will help the company meet investors’ expectation of turning profitable “later this year.” Oak Investment Partners invested in Attivio and had this to say, “Our increased investment underscores our belief that Attivio has game-changing capabilities for enterprises that have yet to unlock the full value of Big Data.” This is a big year for Attivio, who also highlighted such recent business victories as landing lab equipment maker Thermo Fisher Scientific as a client and partnering with medical informatics shop PerkinElmer.

The Benefits of Hiring Freelance Big Data Experts – Smart Data Collective

Attivio Raises $31 Million to Help Companies Make Sense of Big Data – VentureBeat

Hadoop

10 FOLD ICON 15x15The global Hadoop market is expected to grow at a CAGR of more than 53% over the next four years. Several factors such as data explosion in enterprises and demand for cost-effective solutions to meet big data analytics needs contribute to the growth of this market. However, the market is witnessing a lack of trained and talented technical experts. Companies are unaware of the technologies concerned and skills required for managing big data. As per the forecast, this market will witness a gradual shift towards Software as a Service (SaaS)-based Hadoop solutions as it helps enterprises save cost and gain a better user experience.

Global Hadoop Market 2015 – Industry Analysis, Shares, Size, Research, and Forecast to 2019 – Digital Journal

 

IoT

10 FOLD ICON 15x15 IoT is progressively gaining momentum throughout the Middle East and Africa (MEA). This is helping the Middle East due to the continuous drop in oil prices, which is causing governments and businesses to cut their spending budgets. Despite these new restrictions, MEA governments and businesses are looking to diversify their investments into long-term smart technology initiatives that will help enhance their competitive advantage and improve their levels of customer satisfaction. This objective has meant that IoT spending has been largely resilient to the growing budget cuts currently sweeping across other areas of the economy.

10 FOLD ICON 15x15 Consequently, a number of countries in the MEA region are being challenged to meet growing demands for power in order to facilitate the expansion of various business sectors. At the same time, the advocacy surrounding sustainable and clean energy today is spurring growth in smart utilities investments. As a result, the country is seeing an increase in the deployment of so-called Smart Grids (both for electricity and gas) due to the energy management improvements that they provide. Such investments will see IoT spending related to utilities in MEA increase 14 percent year over year in 2016 to total $647.94 million.

10 FOLD ICON 15x15 According to “The Future is Connected” report from SITA – the leading global IT provider to the air transport industry – 83 percent of air travel passengers have smartphones, which allows the unifying technology to provide a connected end-to-end experience. “Half of airlines expect to have IoT initiatives up and running over the next three years. Meanwhile, airports are building the infrastructure to support IoT. Together, this will deliver improved operations and will lead to a change in the passengers’ experience,” said Nigel Pickford, director Market Insight, SITA. Smartphones are reshaping travel behavior and with growth rates of around 80 percent or more at the check-in and boarding pass stages, it is clear that air travelers are keen to use this unifying technology.

10 FOLD ICON 15x15 According to The Economist, sensor-filled “beans,” developed by Andrew Holland, an electronics engineer from Swaffham Bulbeck, could provide an answer to many a farmer’s prayers. Mixed into the contents of the beans are sensors that help report continuously on the temperature and humidity (both of which encourage rotting if they are too high) and on carbon-dioxide levels, which reflect the amount of insect breath exhaled, and thus the level of infestation. If the beans do well at monitoring grain, Holland hopes their other applications will make them an important part of the much-discussed IoT. Ultimately, some believe these beans will help link many things (such as food crops) not currently connected electronically.

‘Internet of Things’ to Transform Air Travel Experience Globally: Report – Zee News India

Cool Beans – The Economist

IIoT

10 FOLD ICON 15x15 Bosch is working together with partners to combine the technical standards of Germany’s “Industrie 4.0” platform and of the Industrial Internet Consortium (IIC) for the first time. This is concerning many people, because if all the energy-intensive machinery in Bosch’s Homburg plant runs at the same time, it can potentially lead to very high electricity consumption at peak times. As a result,the increase in electricity pushes up the cost of manufacturing the hydraulic valves. By using software to manage production and electricity consumption as effectively as possible, energy demand can be optimized and peak loads reduced by up to ten percent. The partners combine their expertise to optimize energy consumption at the plant. Bosch continuously collects data from all the machinery in the plant, generating a stream of information about the electricity consumed in the process of manufacturing the hydraulic valves for agricultural machinery.

Bosch combines “Industrie 4.0” platform and Industrial Internet Consortium standards for the first time – Automotive World

eCommerce

10 FOLD ICON 15x15UK-based, B2B ecommerce software company, On Demand Solutions,  has now launched an ecommerce software solution for B2C retailers. The new solution focuses especially on small and medium-sized companies, and has omni-channel functionality. Additional features allow smaller ecommerce players a responsive online storefront, and ability to control multiple webstores through one CMS, enabling clients to sell their products through multiple marketplaces. Features of these webstores include social media links, intergration with MailChimp, product reviews, vouchers, best-selling items and integration with Google Adwords, Amazon and Ebay. It also integrates with ERP back office software including SAP Enterprise, SAP Business One, Sage 200, Sage 1000 and Astute.

ODSNet launches B2C ecommerce software solution – Ecommerce News UK

Software Defined Networks

10 FOLD ICON 15x15 Yesterday, Microsoft announced it is giving away free software it designed for its own internal use called Software for Open Networking in the Cloud (SONiC). SONiC is software used to run software defined networking,  which threatens to overturn Cisco’s stranglehold on the network switch industry. SDN takes features that an expensive switch offers and puts them into software, making networks easier to program, update and change. Microsoft is giving SONiC software away as part of its work with the Open Compute Project (OCP), an organization founded by Facebook to build open source hardware for data centers the same way that the people behind the Linux operating system do with free, open source software. The two big companies that are not working with SONiC are VMware and Cisco – which could mean trouble for them in the future.

Microsoft just joined Facebook and fired a huge shot at Cisco – Business Insider

10Fold – Big Data Business Insights – 33

Your daily digest of “All Things Big Data” gathered, collected and researched by your very own 10Fold Big Data Practice team.

Big Data

10 FOLD ICON 15x15 Big Data is transforming the way we view medicine by means of clinical trials and studies. Clinical trials work by testing how well a treatment works and identifying any side effects. However, these trials require participants who meet rigorous scientific standards. This is where big data can help. By mining the world of practice-based clinical data — actual patient records — for information on who has what condition and what treatments are working, doctors could learn a lot about the way they care for individuals. Many different companies are searching for a way to enable healthcare providers to learn from practice-based evidence to individually tailor care. Electronic Health Records have been around for a while but with data stored across a number of different  systems and formats, they are not designed with analysis in mind. A future which combines both evidence based and practice based medicine is likely to produce the best outcome for patients.

10 FOLD ICON 15x15  Women in tech have always been outnumbered by men, but this disproportion could be encouraging more females to enter the tech workforce. According to CNET, less than 17% of the tech industry is made up of women. Recently, Big Data and statistic fields have been attracting a surprising amount of females. It’s been noted that women are achieving more than 40% of statistic degrees, and new career paths in data science now hold multiple opportunities for women. The rise of women in the world of data could also be due to the belief that women typically excel in communication and problem solving, two main areas that are required for data-oriented roles.

How Big Data is transforming medicine – Forbes

Are Big Data Career Paths Attracting More Women to Tech? – Huffington Post

Hadoop

10 FOLD ICON 15x15 Hadoop has grown to two significant phases of maturity, defined by how companies first used it and what tools emerged to create a vibrant ecosystem in the process. When it became clear that Hadoop has the ability to provide real business value, many departments started building workloads for business intelligence and reporting to extract meaningful insights. Hadoop is currently in its third phase within enterprise environments. We’re starting to see multi-department uses within organizations. It also comes with a whole new set of requirements that Hadoop has not considered prior. Applications don’t exist yet that will run on Hadoop but it is predicted that will be in the future.

The Phases of Hadoop Maturity: Where Exactly Is it Going? – Data Informed

 

Docker/ Containerization

10 FOLD ICON 15x15 Containers are all the rage among developers, who use the open source software to build, test and run applications. The technology offered by companies such as Docker are not on the radar of most Fortune 500 CIOs, suggesting that it has a ways to go before it gains traction in large enterprises. Most CIOs are unfamiliar with abstract technology and express skepticism. Some of the comments from a live audience poll conducted at a recent Wall Street Journal event indicate that some CIOs believe that the VMs running their private or hybrid clouds are sufficient.

CIOs aren’t ready for Docker and container technology – CIO

IoT

10 FOLD ICON 15x15  Among smart watches, smart appliances, smart homes, and smart buildings come smart cities. The market for smart cities is expected to grow from $52 billion last year to $148 billion by 2020. More than 200 smart city projects are underway around the world, fueling the demand for products and services from IoT vendors, service providers, and platform companies and consultants. North America is expected to dominate the IoT in smart cities over the next several years.

10 FOLD ICON 15x15 IBM just launched a tool called Quark for IoT development. Quark is based on IBM Streams, a product for processing large amounts of live data. Quark is just beginning, although IBM is hoping that by making it open source the community will catch on and help with its development. IBM has an existing suite of tools and services useful for the IoT – such as Watson – but it’s clear the company plans to continue its leadership and won’t slow down progress as competitors like Cisco bolster their own enterprise-level IoT solutions.

IoT Smart Cities Market Heading to $148 Billion – Media Post

IBM launches Quark tool for IoT development – Developer Tech

eCommerce

10 FOLD ICON 15x15 In the last decade, the amount of people shopping online has exploded. The US alone was responsible for 31.7% of global e-commerce sales in 2015. Forbes looked at the their predictions for the trending eCommerce products for 2016 and beyond and decided major tips and tools for launching eCommerce businesses. These include: consumer behavior research, product research, and product ideation.

10 FOLD ICON 15x15 Several articles covered Indian eCommerce company, Snapdeal’s $200 million in new funding, led by Ontario Teachers’ Pension Plan, the Canadian investment vehicle with over $150 billion in assets. The new investment puts Snapdeal’s valuation in the $6.5-$7 billion range, making it the second most valuable startup in India, after Flipkart. Snapdeal says that the capital raised will be used to further build out its technology platform, logistics, payments, and back-end infrastructure.

10 FOLD ICON 15x15 Business to Community recommended 9 ways to get the ABCs of eCommerce right. They are 1) analytics, 2) behavior analysis, 3) customer service, 4) discounts and offers, 5) eCommerce platform, 6) feedback and testimonials, 7) gateway (payments), 8) hacking and security, and 9) inventory management.

Tips and Tools for Launching Your eCommerce Business – Forbes

India’s Snapdeal raises $200 million to challenge Amazon and Flipkart – VentureBeat

Snapdeal raises $200M more to fuel up for India’s ongoing e-Commerce battle – TechCrunch

9 Tools to Get the ABCs of eCommerce Right – Business2Community

Openstack

10 FOLD ICON 15x15 Rackspace has announced a new OpenStack-as-a-Service option in partnership with Red Hat, whose enterprise Linux distribution powers the new cloud platform. The platform is a hosted implementation of Red Hat Enterprise Linux OpenStack Platform, Red Hat’s main product for building open source private and hybrid clouds using OpenStack. While Red Hat’s OpenStack distribution has been available for more than two years, the Rackspace hosted offering provides another way for enterprises to deploy OpenStack as a service rather than a platform they maintain themselves. Rackspace says this is important as a way to speed OpenStack adoption.

Rackspace adds hosted Red Hat OpenStack to Cloud Services – The Var Guy