SlicingDice
 | |
| Private | |
| ISIN | 🆔 |
| Industry | Data Warehousing |
| Founded 📆 | 2016 |
| Founders 👔 | Gabriel Menegat, Rafael Telles |
| Headquarters 🏙️ | , São Paulo , Brazil |
Area served 🗺️ | |
| Products 📟 | Cloud-based data warehousing |
| Members | |
Number of employees | 25+ (2018).[1] |
| 🌐 Website | SlicingDice.com |
| 📇 Address | |
| 📞 telephone | |
SlicingDice is a cloud-based data-warehousing startup publicly launched by Gabriel Menegat in 2016, after spending two years in stealth mode.[2]
History[edit]
In 2012 SlicingDice’s founding company[3], Simbiose Ventures, was building and investing in a DMP (Data Management Platform) [4] to compete against well-known venture-backed companies, such as BlueKai (now Oracle Corporation), Krux (now SalesForce), Aggregate Knowledge (now Neustar) and others.
Because the DMP needs to constantly collect, process and update huge amounts of data from hundreds of sources while allowing its customer slice and dice the data in order to create user segments, the task was to daily collect billions of data points from hundreds of sources, process them in near real time and store these data in a way the DMP customers could play around quickly. Although difficult to solve, the technical challenges that boosted SlicingDice's creation were simple to describe:
- Difficulties with data modeling when merging non-time-series and time-series queries
- How to support all kind of queries without having hundreds of servers and still expect sub-second responses
- Slow queries
Before building SlicingDice’s core time series database technology (S1Search), most of the amazing big data (SQL and NoSQL) solutions out there were considered, like:
- ElasticSearch and Solr
- Apache Hadoop / Apache Hive, Apache Storm, and Apache Spark
- MemSQL
- Amazon Redshift
- Google BigQuery
However, some of them didn’t support Simbiose's needs (like low-latency full distributed JOIN) and the few that supported were complex to manage and it would require a dedicated team. Some solutions that could possibly support the technical requirements were found, but they were really complex and expensive in terms of hardware usage or software licensing, like:
So, because of those difficulties, back in 2015, SlicingDice started to be developed by Simbiose Ventures [3]
Technology[edit]
The technology used by SlicingDice is called S1Search [5], a Java-based Data Warehouse and Analytics Database. S1Search was strongly inspired by Apache Lucene’s (and ElasticSearch’s) data insertion techniques and search engine concepts — such as inverted index — , also combining well-known concepts from other successful performant databases — like column-store data modeling.
Databases are usually classified according to the abstraction they provide to the system using it. Many traditional databases follow a so called relational model which is backed by sound mathematical theory. Although broadly adopted, alternatives to this model have been growing consistently from the 2000’s on as a multitude of databases were created with new models that allow cheaper management of big data.
The so called non-relational databases span a list of categories that include: key-value store, document store, graph database, wide-column store and others. With so many competing models on the database ecosystem, it should be clear that a definitive solution has not yet been found and that there is still space for innovation. This is the case of S1Search: although similarities can be traced, none of the known models are exactly a description to what S1Search implements.
A key difference of S1Search to traditional databases is regarding which columns are used to keep an index and which are used to keep a materialized view. Traditional databases keep a materialized view of every column and indexes of few columns whereas S1Search keeps indexes of all columns and materialized view of few ones.
References[edit]
- ↑ Company, SlicingDice (April 24, 2018). "SlicingDice's team webpage". SlicingDice.com. Retrieved April 24, 2018.
- ↑ Menegat, Gabriel (March 17, 2017). "SlicingDice.com is now LIVE". Retrieved March 17, 2017.
- ↑ 3.0 3.1 Menegat, Gabriel (March 14, 2017). "Why we built SlicingDice?". Retrieved April 24, 2017.
- ↑ Stripoli, Gabriela (September 30, 2014). "Simbiose Ventures: "O Brasil precisava de uma DMP local"". Retrieved April 24, 2018.
- ↑ Menegat, Gabriel (March 16, 2017). "SlicingDice Uncovered (S1Search)". Retrieved April 24, 2017.
External links[edit]
This article "SlicingDice" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:SlicingDice. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.
