StormCrawler™ software is an open source SDK for building low-latency, scalable web crawlers based on Apache Storm®. You can download StormCrawler™ software here (latest release: 3.7.0), or pick individual artifacts below.

Apache StormCrawler 3.7.0 LATEST

Source release, signed and checksummed:

SOURCE TAR.GZ RELEASE NOTES ↗ MAVEN CENTRAL ↗

Chain of trust

You must verify the integrity of the downloaded files: every release ships with everything you need to prove it came from us. The chain has four links:

01 · GET

Source archive

Fetch the tar.gz from an Apache mirror.

TAR.GZ

02 · CHECK

Integrity

Your SHA-512 checksum must match ours.

SHA512

03 · PROVE

Authenticity

The OpenPGP signature (*.asc) is made by a release manager.

ASC

04 · TRUST

Key ring

Match the signature against the project's KEYS file.

KEYS

Verify like a release manager

$ sha512sum -c apache-stormcrawler-3.7.0-source-release.tar.gz.sha512
$ gpg --import KEYS
$ gpg --verify apache-stormcrawler-3.7.0-source-release.tar.gz.asc

More information about release signing and verifying signatures can be found here.

Maven

Artifacts are available via Maven Central.

Older Releases

Earlier ASF releases are listed on the GitHub releases page and remain available from the Apache archive. Previous non-ASF releases (group com.digitalpebble.stormcrawler) can be found on Maven Central.

Migrating from 2.x

Coming from a pre-Apache (DigitalPebble) release? The migration guide covers the new Maven coordinates, package renames and removed modules.