Kite Morphlines
Morphlines is a data transformation and enrichment framework originally developed by Cloudera as part of Cloudera Search:[1]. It uses JSON to define the transformation pipeline, templates, functions and variables. Its primary use is to provide an easy and flexible layer to transform and transfer data between Apache Solr, Apache HBase, HDFS, and data warehouses[1].
The framework is developed in Java and provides the ability to create new commands inline or to import them through external dependencies. Morphlines can be setup to run on top of an Apache Hadoop MapReduce job, or it can be executed independently as a Java program.
| Developer(s) | Kite Software Development Kit |
|---|---|
| Stable release | 1.1.0
/ June 16, 2015 |
| Repository | github |
| Engine | |
| Type | Software framework Data transformation |
| License | Apache License 2.0 |
| Website | kitesdk |
Search Kite Morphlines on Amazon.
Commands[edit]
Commands are the basic development structure in Morphlines[2], commands are chained together to gather, transform or publish data. They're grouped in packages according to their common purpose. Such packages are[3]
- kite-morphlines-core-stdio, basic input/output commands.
- kite-morphlines-core-stdlib, common usage commands for logging, comparison, execution flow, etc.
- kite-morphlines-avro, commands for Apache Avro manipulation.
- kite-morphlines-json, JSON handling commands.
- kite-morphlines-hadoop-core, HDFS file reading.
- kite-morphlines-hadoop-parquet-avro, unpacking of Apache Parquet files.
- kite-morphlines-hadoop-rcfile, parsing Hadoop RC files.
- kite-morphlines-hadoop-sequencefile, parsing Hadoop sequence files.
- kite-morphlines-maxmind, geolocation lookup based on IP address.
- kite-morphlines-metrics-servlets, gather and expose Morphlines' metrics.
- kite-morphlines-protobuf, Protocol Buffers reading and extraction.
- kite-morphlines-tika-core, core Apache Tika interaction.
- kite-morphlines-tika-decompress, decompressing and unpacking of files like gzip, zip, jar, etc.
- kite-morphlines-saxon, interaction with Saxon for markup language parsing and transformation.
- kite-morphlines-solr-core, Solr basic interaction commands.
- kite-morphlines-solr-cell, Solr cell creation commands.
- kite-morphlines-useragent, user agent parsing commands.
References[edit]
- ↑ 1.0 1.1 "Morphlines Introduction". kitesdk.org. Retrieved 2018-01-29.
- ↑ "Cloudera Kite Morphlines Getting Started Example". techidiocy.com. Retrieved 2018-01-29.
- ↑ "Morphlines Reference Guide". kitesdk.org. Retrieved 2018-01-29.
This article "Kite Morphlines" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:Kite Morphlines. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.
