100% OPEN SOURCE LOW LATENCY, HIGH-THROUGHPUT STREAMING TECHNOLOGY
Tigon is an open source real-time stream processing framework built on top of Apache Hadoop and Apache HBase, built by Cask in collaboration with AT&T Labs. Tigon heavily leverages open source projects Tephra and Apache Twill and provides a tight integration with your existing Hadoop/HBase cluster. Tigon has an exactly-once processing guarantee; thus, your logic can safely perform non-idempotent operations.
Tigon Applications are referred to as Flows. A Flow can be logically represented as a Directed Acyclic Graph, with each node representing a processing unit. These processing units are referred to as Flowlets. The data flow between the processing units happen through Queues.
Flows are spun up by Tigon as YARN containers using Twill. This provides the runtime elastic scalability of Flows. Additional instances of Flowlet containers can be spun up with simple CLI commands.
Flowlets can store data in HBase, if required, with ACID properties using Tephra.
TigonSQL is an in-memory stream processing library that ships with the Tigon project. Users can leverage this library to ingest massive amounts of data streams into their Hadoop/HBase cluster and perform CEP-like continuous query semantics with a SQL-like declarative language.
Tigon supports different runtimes for various environments. You can run your flow on a single computer or on the distributed runtime of a Hadoop cluster. Distributed mode of Tigon comes with an intuitive Command Line Interface to help users start and manage their Tigon Flows.
You can download the latest Tigon ZIP. These are the prerequisites for using Tigon from the downloaded ZIP archive:
- JDK 6 or JDK 7 (required to run Tigon; note that $JAVA_HOME should be set)
- Apache Maven 3.0+ (required to build the example applications)
Additional notes and details are included in the README file of the downloaded ZIP archive and online in our Getting Started documentation.
You can use our Getting Started documentation to guide you through installing Tigon and running the examples shipped with the distribution.
Once you have familiarized yourself with Tigon, you can next take a look at Tigon’s Developer Guide. This will help you learn building your own flows for Tigon.
Released on: 30th October, 2014
This is a bug fix release of Tigon. In this release, we fixed a bug in TigonSQL which mapped all schemas to a default interface set, resulting in incorrect outputs. Instead, we now have a single interface per input schema with no default interface set.
Released on: 15th October, 2014
This is the second developer release of Tigon. In this release, live logging support for distributed mode has been added, libcurl dependency for TigonSQL has been removed and a new Tigon Apps Repo, which contains reference applications for Tigon, is now available.
Released on: 25th September, 2014
This is the first developer release of Tigon.
We would love to get contributions from you. You don’t need to be a Hadoop or a Distributed Systems expert to contribute to Tigon. Of course, if you are a Hadoop developer, we welcome your contributions too.
- If you are passionate about fast, high performance data processing systems, Tigon is for you and is built by people like you.
- Take a look at our issues and consider submitting a patch.
We have a simple pull-based development model with a consensus-building phase, similar to Apache’s voting process. If you’d like to help make Tigon better by adding new features, enhancing existing features, or fixing bugs, here’s how to do it:
- If you are planning a large change or contribution, discuss your plans on the tigon-dev mailing list first. This will help us understand your needs and guide your solution in a way that best fits the project.
- Fork Tigon into your own GitHub repository.
- Create a topic branch with an appropriate name.
- Work on the code to your heart’s content.
- Once you’re satisfied, create a pull request from your GitHub repo (it’s helpful if you fill in all of the description fields).
- After we review and accept your request, we’ll commit your code to the repository.
Thanks for helping to improve Tigon!