Tag Archives: hortonworks

Big Data Horizons- Solution Providers, Security Needs

100 Most Promising Big Data Solution Providers 2017

“Data generation and utilization continues to grow by leaps and bounds and with it the investments in big data analytics solutions and services”

In present times, companies worldwide are starting to espouse newfangled big data technologies whereby they can establish viable partnerships, delve into new markets, and transform their businesses into a data-driven brand. This scenario is further getting augmented with the big data’s growing prominence in the development of artificial intelligence (AI) and deep learning applications. For the coming times, the increasing adoption of AI and machine learning alongside the spawning of IoT applications is going to be the key to success for data-driven enterprises.

The big data industry is growing larger and larger each day with the amount of information being collected and the potential insights it can deliver steadily growing. As the year comes to an end, CIO Review once again published their annual “100 Most Promising Big Data Solution Providers” list. In it, some of the biggest big data names of the year, including new companies that have delivered on new AI and deep learning applications that are made for big data solutions. It is clear that companies worldwide are jumping onto new innovations to provide the biggest value for their solution. A few notable listings include.

  • Cloudera
  • Hortonworks
  • MapR Technologies
  • Tableau Software
  • SAS institute

Big data in the UK Police Force

“Advanced uses of analytics to improve policing”

Among the numerous ways in which big data technology could be applied to UK policing, four are identified as key priorities by the report.

  • Predictive crime mapping: this ‘could be used to identify areas where crime is most likely to occur, allowing limited resources to be targeted most efficiently.
  • Predictive analytics: this ‘could also be used to identify the risks associated with particular individuals. This includes identifying individuals who are at increased risk of reoffending, as well as those at risk of going missing or becoming the victims of crime.’
  • Advanced analytics: this ‘could enable the police to harness the full potential of data collected through visual surveillance, such as CCTV images and automatic number plate recognition (ANPR) data.
  • Big data technology: this ‘could be applied to open-source data, such as that collected from social media, to gain a richer understanding of specific crime problems, which would ultimately inform the development of preventive policing strategies.

With new big data applications coming out everything, a common trend amongst consumers is the worry of what data should is being collected and how it is being utilized. Although the police force is seeing positive results from the use of big data analytics, it will be interesting to see the citizens’ response to the police force’s ability. However, as stated in the article, with the low number of officers available to the public, policing needs any technological help it can receive.

Big Data Needs Bigger Security

“The big data age has come, now we need security to back it up”

Last week, Equifax lost highly confidential personal and financial data on as many as 143 million people. The worst part? You didn’t even give them permission to obtain this information. They can legally collect, store and share it regardless.

Nearly two months after the breach, they are “letting consumers know” if they have been affected. You could supposedly go online to determine if your data was compromised, but that has already been exposed as a self-serving, non-functioning trick mostly aimed at providing “help” of only temporarily free services – profiteering from this breach in full view of all. Choosing paltry offers of either one year of free credit tracking or a one-time credit freeze, you had to also initially agree not to pursue legal action against them to obtain these fixes. What genuine contrition and offer of help does that constitute?

Big companies made “big data” happen. Now, “big security” must follow, despite the costs. Regulators and legislators need to remind them through coordinated actions that they can spend it now to protect us all in advance or pay it later in big fines when they don’t. But either way, they are going to pay. Otherwise, the only ones paying will be consumers.

With the ethical implications already being questioned regarding collected data without permission or knowledge of the consumer, the leaking of the unknown information is the cherry on top. As cyberattacks increase in potential threat and size everyday, corporations are in need now more than ever of the highest grades of cybersecurity. Consumers are becoming more weary of data protection, and it will be interesting to see how Equifax and other corporations will address their current implementations of security of data after this incident.

Enjoy your read? Check out our other content here.

Big Data Horizons- HiQ Labs and LinkedIn, Asian Pacific Trend

We have a US $65B big data opportunity in Asia Pacific, and the trends point to big benefits

“Global Big Data market growing fast”

Market intelligence firm IDC has stated that the worldwide big data market cap is expected to hit $203 billion in the near future, with the Asian Pacific (APAC) leading much of the growth. IDC claims that organizations investing in productivity benefits in the region could attain $65 billion in reward by 2020 over competitors. Further, 53% recognize the necessity of big data for business and that they currently do, or will rely on it for their market survival in the future.

Imanis Data focuses on big data backup and recovery

“Necessary, as three of four firms has suffered data loss in the last year”

Imanis Data, formerly Talena, has released eponymous backup and recovery platform version 3.0, which emphasizes support for large datasets generated by companies on the new era of big data.

Version 3.0 is claimed to strengthen backup architecture, recover and replicate terabyte and petabyte-sized data sets up to 10 times faster than any other solution on the market, and minimize the impact of data loss by reducing costly days and weeks of downtime to minutes and hours and reducing secondary storage costs by almost 80%.

The company has also claimed that its data backup platform utilizes cloud-based data replication to provide backup and disaster recovery across different regions and providers. This will essentially allow a user to split their backup across Microsoft Azure Blob Storage and HDInsight, while also including Amazon S3 and the Hortonworks cloud distribution for Hadoop.

Judge orders LinkedIn to unblock startup from scraping public profile data: Report

“Ordered to unblock HiQ Labs from scraping public data”

U.S. Judge Edward Chen has has ruled that LinkedIn must allow the talent management startup HiQ Labs from collecting profile data from users within 24 hours on Monday.

HiQ Labs responded to the verdict on Monday “This ruling allows us to continue serving our clients while we seek to permanently prevent LinkedIn from monopolizing the aggregation and analysis of publicly available information on the web,”

LinkedIn had first confronted HiQ in May with a letter asking them to cease data collection of LinkedIn profiles for their business practices which uses publicly available “people data” to train its AI models to predict employee behavior.

Judge Chen, in his ruling on Monday, claims that adopting LinkedIn’s “broad interpretation” of CFAA “could profoundly impact open access to the internet, a result that Congress could not have intended when it enacted the CFAA over three decades ago.”

Enjoy your read? Check out our other content here.

10Fold- Big Data Horizons

EU’s Copyright Reform Might End AI & Big Data Startups

“Industry watchers concerned”

Many industry leaders and entrepreneurs have stated their intentions to pull their activities outside of the European bloc if current copyright reform measures advance. According to Lenard Koschwitz of Allied for Startups, the most controversial aspect for affected fields is in regards to data and text mining programs. Many committees in the European Parliament have proposed that startups may only do these activities within three years until explicit permissionmust be obtained from its original sources.

Mark Zuckerberg, Priscilla Chan Donate $10M to Advance Health Using Big Data

“Spearheading Data Recycling research” 

Contrasting traditional research that recruits groups of patients and collects data from scratch, new research suggests that mining the millions of gigabytes of publicly existing data can yield great insights. Those who know where to look in health and medicine records can find them, all while protecting the privacy of the individuals whose records are being examined.

IBM Tames Big Data by Blending All-Flash Storage and Spectrum Scale Software

“Storage solution targeting big data workloads”

IBM enterprise customers will have access to insights with greater speed and with a new bundled storage solution. The software is Hortonworks Data Platform Certified and includes the EES and Spectrum Scale storage services and management processes, delivering data throughput rates that are 60% faster than previous products. The estimate is based on the 40GB per second maximum provided by the ESS GS6S array as compared to the ESS GS6 25 GB per second limit.

Before the Next Disaster Strikes, Get Better at Data Science

“Data invaluable tool to mitigate risk of asset failure”

Applied data science and advanced software can provide huge insights into machine health and help to foresee mechanical issues before they occur. This progressive data science is aiding industrial operating systems transition from reactive to proactive maintenance and compliance techniques, improving safety and saving money.

Enjoy your read? Check out our other content here.