Our website makes use of cookies like most of the websites. In order to deliver a personalised, responsive and improved experience, we remember and store information about how you use it. This is done using simple text files called cookies which sit on your computer. These cookies are completely safe and secure and will never contain any sensitive information. By clicking continue here, you give your consent to the use of cookies by our website.

Friday, 25 September 2015 13:20

Criteo creates biggest European private Hadoop cluster with Huawei

Written by 

Digital advertising business Criteo chooses Huawei servers to build the biggest private big data platform in Europe to handle delivery of three billion unique banner advertisements per day

Chinese communications and IT business Huawei has been chosen by French digital advertising re-targeting business Criteo, to supply 700 servers for its new Hadoop Cluster data centre based in Pantin in Paris.

The Parisian-based business works with Internet retailers to deliver personalised online display advertisements based on sites users have previously visited and relies on big data solutions to analyse data and deliver the right advert in milliseconds.  The company currently sees around 30 billion HTTP requests per day (including as many as two million requests per second), and delivers three billion unique banner advertisements per day, which creates 20 terabytes of new data daily – the business has capacity for 37 petabytes of raw storage.

The platform will be built on Huawei’s FusionServer RH2288H V3 models, which consists of a large number of high-capacity disks and feature high storage density with 10% less energy consumption thanks to their specialist design and heat dissipation.

The new Huawei server Hadoop platform represents a gain of 30% in processing performance, thereby improving the Criteo Engine’s performance. In this first stage of the project, some 700 machines have been installed in the data centre, providing more computing power and storage than the Criteo data centre in Amsterdam, which has a total of 1,200 servers. In the longer term, the Pantin data centre will consist of up to 5,000 servers over 350m2 with a power of 2 MW.

Recently Criteo released to the independent research community the largest dataset ever. The four billion plus dataset totals over one terabyte in size, and was released as part of its Display Advertising Challenge conducted with Kaggle. The latest dataset has already been put to use as a benchmark by researchers at Carnegie Mellon University, with more academic and research applications forthcoming.

"This is the biggest private Hadoop platform in Europe as of today," said Matthieu Blumberg, Senior Engineering Manager (Infrastructure Operations). "Huawei has undeniably good ICT solutions and extensive knowledge of Big Data. We were really impressed by the quality of their response to the tenders and support provided during the deployment of their servers."

Leave a comment

Make sure you enter the (*) required information where indicated. HTML code is not allowed.

IBM skyscraper2

datazen side

Most Read Articles