Configuring AWS CloudWatch Connectors

The AWS CloudWatch connector allows Stellar Cyber to collect AWS ECS/EKS, WAF, and Amazon GuardDuty logs. Use these instructions to obtain credentials and set up the connector.

Although the AWS CloudWatch connector may successfully import other logs, only AWS Elastic Container Service (ECS)/Elastic Kubernetes Service (EKS), Web Application Firewall (WAF), and Amazon GuardDuty logs are supported in this release due to performance issues that can occur with other log types. Stellar Cyber is working on enhancements for other log types in future releases.

You can use an AWS CloudWatch connector to ingest logs from Amazon GuardDuty findings by exporting those logs to your AWS CloudWatch service. Refer to Amazon's documentation for configuration of this export: https://docs.aws.amazon.com/guardduty/latest/ug/guardduty_exportfindings.html .

Stellar Cyber connectors with the Collect function (collectors) may skip collecting some data when the ingestion volume is large, which potentially can lead to data loss. This can happen when the processing capacity of the collector is exceeded.

Connector Overview: AWS CloudWatch

               Let us know if you find the above overview useful.

Adding an AWS CloudWatch Connector

To add an AWS CloudWatch connector:

1. Add an AWS user
2. Create an access key
3. Identify CloudWatch log groups
4. Add the connector in Stellar Cyber
5. Test the connector
6. Verify ingestion

Adding an AWS User for Stellar Cyber

Use our example as a guideline, as you might be using a different software version.

To add a user with the appropriate permissions:

1. Log in to your AWS Management Console at https://aws.amazon.com/console. View the services in the Console Home or choose View all services.

   

2. Choose IAM. The IAM Dashboard appears.

3. Choose Policies and then choose Create Policy.

   

4. In the Create policy pane, choose the JSON tab.

   

5. Using the example below as a guide, edit the JSON policy document.

   The following is just an EXAMPLE. You must modify this JSON to match the resources in your own environment.

   Copy

   CloudWatch policy

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   11
   12
   13
   14
   15
   16
   17
   18
   19
   20
   21
   {
       "Version": "2012-10-17",
       "Statement": [
           {
               "Sid": "VisualEditor0",
               "Effect": "Allow",
               "Action": [
                   "logs:DescribeLogGroups",
                   "logs:DescribeLogStreams",
                   "logs:GetLogEvents",
                   "logs:FilterLogEvents"
               ],
               "Resource": "*",
               "Condition": {
                   "ForAnyValue:StringEquals": {
                       "aws:RequestedRegion": "us-west-2"
                   }
               }
           }
       ]
   }

6. Choose Next.

7. Give your policy a name to associate it with Stellar Cyber, then choose Create policy.

   

   The policy can now be attached to a user.

8. From the IAM navigation pane, choose Users and then choose Create user.

   

9. In the Specify user details page for User details, enter a User name for the new user.

10. Choose Provide user access to the – AWS Management Console optional to produce login credentials for the new user, such as a password.

11. Choose how you want to create the Console password and then choose Next.

12. For Set permissions, choose Attach policies directly. Then search for the policy you created above.

    

13. Select the checkbox to the left of the policy name, then choose Next.

14. Verify the information and then choose Create user.

Creating an Access Key

For Access Key / Secret Key authentication, you will need the access key and secret key when configuring the connector in Stellar Cyber.

1. Log in to the IAM Console with your AWS account ID, your IAM user name, and password. You must have the permissions required to create access keys for a user.

2. Choose Users, then choose the user name, and click Security credentials.

   

3. In the Access keys section, choose Create access key. Access keys have two parts: an access key ID and a secret access key. Click Create access key.

   

4. On the Access key best practices & alternatives page, choose Other and then choose Next.

   

5. Click Create access key.

6. On the Retrieve access keys page, choose Show to reveal the value of the user's secret access key. Save the access key ID and secret access key in a secure location. You will need them when configuring the connector in Stellar Cyber.

   

7. Click Done.

Identifying AWS CloudWatch Log Groups

For this connector, you will specify one or more log groups to ingest. Use this procedure to locate the group names (this procedure assumes that you have already configured your CloudWatch instances and log groups).

1. Log in to your AWS CloudWatch Console at https://console.aws.amazon.com/cloudwatch/ .

2. Navigate to the Logs section of the left hand navigation pane.

3. Select Log Groups.

   

4. Make note of the groups you want to ingest to Stellar Cyber.

Adding the Connector in Stellar Cyber

With the credential and log information available, you can now add the AWS CloudWatch connector in Stellar Cyber:

1. Log in to Stellar Cyber.

2. Click System | Integration | Connectors. The Connector Overview appears.

   

3. Click Create. The General tab of the Add Connector screen appears. The information on this tab cannot be changed after you add the connector.

   

   The asterisk (*) indicates a required field.

4. Choose PaaS from the Category drop-down.

5. Choose AWS CloudWatch from the Type drop-down.

6. For this connector, the supported Function is Collect, which is enabled already.

7. Enter a Name.

   This field does not accept multibyte characters.

8. Choose a Tenant Name. The Interflow records created by this connector include this tenant name.

9. Choose the device on which to run the connector.

10. (Optional) When the Function is Collect, you can create Log Filters. For information, see Managing Log Filters.

11. Click Next. The Configuration tab appears.

    

    The asterisk (*) indicates a required field.

12. For Access Key / Secret Key authentication:

    1. Enter the Access Key you noted above in Creating an Access Key.

    2. Enter the Secret Key you noted above.

13. Choose a Region from the available regions in the drop-down.

14. Enter the Log Group(s) as named in your AWS CloudWatch console. To enter multiple log group names, press Enter after each name.

    If you want to enter Log Stream(s) in the optional step below, you can only enter one Log Group in this step.

15. (Optional) Enter the Log Stream(s). Provide a list of log stream(s) that correspond to the provided log group. To enter multiple log stream names, press Enter after each name. If log streams are not specifically listed, every log stream within the provided log group is automatically searched.

16. Choose the Interval (min). This is how often the logs are collected.

17. Click Next. The final confirmation tab appears.

    

18. Click Submit.

    To pull data, a connector must be added to a Data Analyzer profile if it is running on the Data Processor.

The new connector is immediately active and starts collecting logs.

Testing the Connector

When you add (or edit) a connector, we recommend that you run a test to validate the connectivity parameters you entered. (The test validates only the authentication / connectivity; it does not validate data flow).

For connectors running on a sensor, Stellar Cyber recommends that you allow 30-60 seconds for new or modified configuration details to be propagated to the sensor before performing a test.

1. Click System | Integrations | Connectors. The Connector Overview appears.

   

2. Locate the connector that you added, or modified, or that you want to test.

3. Click Test at the right side of that row. The test runs immediately.

   Note that you may run only one test at a time.

Display sample messages...

Success !

Failure with summary of issue: Show More example detail:

 

Verifying Ingestion

To verify ingestion:

1. Click Investigate | Threat Hunting. The Interflow Search tab appears.
2. Change the Indices to Syslog. The table immediately updates to show ingested Interflow records.