Skip to main content
Sumo Logic

Configure Data Forwarding from Sumo Logic to S3

After granting access to the S3 bucket, you can configure Data Forwarding. After Data Forwarding is configured, you should start to see file objects posted within your configured bucket. The log messages are accumulated and returned after being ingested by Sumo Logic. See File Format for Data Forwarding to an Amazon S3 Bucket for information on the file format of the posted objects.

  1. Make sure to have your AWS Key ID and Secret Key set up to allow Sumo Logic to write to the S3 bucket.
  2. In Sumo Logic, choose Manage > Data Forwarding.
  3. Click +.
  4. Select Amazon S3 for Destination Type.
  5. Configure the following:
  • Destination Name. Enter a name to identify the destination.
  • Bucket Name. Enter the exact name of the S3 bucket. The description is optional.
  • Access Key ID. Enter the access key ID generated for Sumo Logic.
  • Secret Access Key. Enter the secret access key generated for Sumo Logic.
  • S3 Region. Select the S3 region or keep the default value of Others. The S3 region must match appropriate S3 bucket created in your Amazon account. For example, if the bucket is in Seoul, Seoul must be selected in here.
  • Enable S3 server-side encryption. Select the check box if you want the forwarded data to be encrypted.
  • Active. Select this check box to enable Data Forwarding for the entire S3 bucket. To start Data Forwarding you will also need to enable forwarding for the desired indexes, as described below in this topic.
    df02.png
  1. Click Save.

If Sumo Logic is able to verify the S3 credentials, the destination will be added to the list of destinations, and you can start Data Forwarding for specific Partitions or Scheduled Views, as described in the following section in this topic. See "Error and alert conditions" in this topic for examples of errors that can occur.

df03.png

Start Data Forwarding to S3 

  1. In Sumo Logic, choose Manage > Indexes or Manage > Partitions.
  2. Click the arrow to the right of the index for which you want to enable Data Forwarding and select Edit Data Forwarding.
    You can also enable Data Forwarding when you first create a Partition or Scheduled View by selecting the Enable Data Forwarding check box.
    df05.png
  3. Select the forwarding destination. 
    You can choose a previously configured destination, or click New Amazon S3 Destination to set up a new one. If you select the new option, you’ll see all of the settings to add a new Data Forwarding destination. See the previous procedure in this topic for instructions on configuring the settings.
    df06.png
  1. For File Format, you can enter a path name or other file format and include any of the following variables, as in the previous screenshot: 

{day} Replace with the day of the year in the yyyy-MM-dd format
{hour} Replace with hour in day (0-23)
{minute} Replace with minute in hour
{second} Replace with second in hour
{uuid} Replace with a unique, randomly generated identifier (UUID)

If you leave this field blank, the default format {index}_{day}_{hour}_{minute}_{second} is used.

  1. Click Save to save your changes and start forwarding data. 

Error and alert conditions

An error or alert condition can occur with S3 Data Forwarding destination for the following reasons:

  • If Sumo Logic is not able to verify the S3 credentials when the destination is saved, an error message indicates that the credentials were rejected by Amazon. If this occurs, verify Access Key ID, Secret Access Key and the bucket configuration, reselect the Active check box, and save again.
    dfd01.png
     
  • Errors and alerts that are generated after the destination has been successfully saved and started are shown on the Indexes page. 


    Hover over the icon to display the message​. In this example, the user has disabled the S3 bucket, and an alert message indicates that data cannot be forwarded.
    dferror01.png

    In this example, Sumo Logic has disabled Data Forwarding due to errors in connecting to the S3 bucket. This occurs if the Amazon account or credentials change so that Sumo Logic is no longer able to authenticate to the bucket.

Data Forwarding Destination Actions

The following actions are available on the Manage > Collection > Data Forwarding page. Hover over a destination in the table and select any of the following:

  • Click the Information icon to display details about configured destination, including the status and any indexes that are currently forwarding to the destination.
  • df04.png
  • Click the Edit icon to make changes to the configuration.
  • Click the Delete icon to delete the destination.  If the destination is currently active, you must inactivate it before it can be deleted. See "Inactivate Data Forwarding" in this topic.

Activate or Inactivate Data Forwarding

If you’d like to start or stop forwarding data, you can activate or inactivate the S3 bucket. 

  1. In Sumo Logic Web, choose Manage > Collection.
  2. Click Data Forwarding.
  3. Hover over the destination and click the Edit icon.
  4. Select or deselect the Active checkbox.
  5. Click Save.