Stream Network Activity to Amazon Data Firehose

Amazon Data Firehose is a fully managed service for delivering real-time streaming data to destinations such as Amazon Simple Storage Service (Amazon S3), Amazon Redshift, an other AWS services. You can use Amazon Data Firehose as a bridge between NetBird and other third-party providers that support Data Firehose to ingest, transform and analyze your network activity events.

Prerequisites

Before you start creating and configuring an Amazon Data Firehose event streaming integration, ensure that you have the following:

  • An AWS account with the permissions to create and manage Data Firehose delivery streams.
  • Permissions to create and manage IAM users, roles and policies.

If you don't have the required permissions, ask your AWS administrator to grant them to you.

Create a Data Firehose Stream

  • Navigate to the Data Firehose Dashboard
  • Click Create Firehose stream
  • As source select Direct PUT and the desired destination
  • Give it a descriptive name like netbird-activity-events and configure the stream to your needs

Create an IAM User

  • Navigate to the IAM Dashboard
  • Create an IAM User (for details see the Amazon Docs)
  • Create a custom policy with the following permissions (replace the resource with the ARN of your delivery stream):
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "firehose:PutRecord",
                "firehose:PutRecordBatch"
            ],
            "Resource": "arn:aws:firehose:region:accountID:deliverystream/netbird-event-streaming"
        }
    ]
}
  • Attach the policy to the IAM user
  • Select the user and navigate to the Security credentials tab
  • Click Create access key
  • Select Third-party service and click Next
  • Give it a description
  • Store Access key and Secret access key in a secure place. You will need these when configuring an integration in NetBird.

Create an Integration in NetBird

event-streaming-integration

  • Enable and configure the Amazon Data Firehose integration
  • First select the region your Firehose stream is created in

firehose-region-select

  • Then enter the Firehose stream name you created in Step 1 and click Next

firehose-stream-name

  • Enter the Access key and Secret access key you created in Step 2 and click Connect

firehose-iam-credentials