Facebook open sources F14, a fast and efficient hash table

by | Apr 26, 2019

ETIQUETAS: Hot news | Open source

Facebook has released F14 , one of the tools it uses to manage the enormous amount of data that the social network moves daily. It is a hash table developed in C + + programming language, which is already available in Folly, the Open Source component library of the social network.

Hash tables are associative arrays or containers that are used to store and search for data quickly. They are able to perform these tasks optimally even if the volume of data increases dramatically.

F14 is a 14-way probing hash table, it uses a hybrid storage called F14Fast, which chooses the most efficient approach to store data based on the types of value. “Its core algorithm leverages vector instructions to increase the load factor while reducing collisions, because it supports multiple memory layouts for different scenarios, delivering a CPU and RAM efficiency that is robust across a wide variety of use cases”, explain Facebook software engineers Xiao Shi and Nathan Bronson in a blog post.

The operation of this tool is based on a strategy called chunking to reduce the likelihood of collisions. Performance is significantly improved by reducing CPU and memory overhead by managing empty slots in the hash table, which is quite useful in cases where many insertion and deletion workloads are handled.

Other aspects that improve performance are the use of less code and the fact that F14 reduces the need to create objects and copies within the hash tables and the surrounding code.

F14 is available for download at GitHub.

See all the technical details at Facebook official blog .

SHARE

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

Recent posts

VDI: The most secure environment for hybrid working

Today is Data Privacy Day. The purpose of this date is to raise awareness and promote privacy and data protection best practices. It was initiated by the European Commission, the Council of Europe, and the Data Protection authorities of the European Union’s member states. Their main goal was to drive attention to the importance of privacy, user data protection, and compliance of the General Data Protection Regulation (RGPD). It is a regulation characterized by significant fines for non-compliance since its implementation in 2018.

How to avoid issues with virtual machines

Virtualization comes with a wide range of benefits for organizations. It helps cut IT costs and reduces downtime while increasing efficiency and productivity. It also increases the resiliency of networks, primarily when disasters occur, and promotes more green-friendly operations.

However, using virtual machines also comes with a set of downsides. Information security may get compromised, workloads mixed up, separation duties lost, among other issues. It is vital to know how you can get over these problems, and that’s what this article will discuss.

Let’s get started.

Archives


Stay up to date with all the news from UDS ENTERPRISE through our social networks. Follow us!

Skip to content