Exports
If you want to migrate to the last version of Data Flow (Piano Analytics), you can find the Data Flow migration guide here.
Creating a Push export
In order to create a Push Export on a Flow, it is necessary to save the Flow beforehand.
Once the Flow has been saved you will be able to configure an export by clicking the "Export" button above the Flow's URL.
This will prompt the "Create a scheduled export" configuration window below.
Name of scheduled export - the name of the scheduled export will enable you to identify your file one it has arrived on your S3 bucket or (s)FTP
Frequency - You are able to choose between "Every hour" and "Every half hour"
Site - In this drop down list you need to specify the site for which you would like to set up a push export
Format - You must specify if you wish to receive your files in JSON or CSV format
Send Mode - You must specify where you wish to receive the file: Amazon S3 bucket, FTP or sFTP
Settings - this section enables you to fill out the necessary details for AT Internet to push the Data Flow files to your Amazon S3 bucket, FTP or sFTP. All past configurations will be available via the drop-down list
Start the schedule - In this section, you have the posibility to specify when you would like to receive the first file. Caution: if the the option "immediately" is selected flow will start to be sent to the destination in the following full half-hour or hour.
Note: when you hit "Save" your parameters will have been registered and the exports will start being pushed to your desired location as per your specifications. The name of the files received will resemble the example received file name provided.
Configuring Amazon S3 connections
Configuring Amazon S3 connections is also a straight forward process.
In order to start, select "Amazon S3" as the send mode when setting up to your Data Flow Push Export.
Then select "Add an Amazon S3 configuration":
You will be prompted with the following configuration window. In order for to know where to push the Data Flow files and have the necessary rights to send the files we need the following information:
S3 Configuration Name - the information requested here is for your reference. This will enable you to find and edit your connection amongst your other Amazon S3 connections you may have configured with AT Internet
Bucket Name - We need inforation regarding the name of your Amazon S3 bucket. This is a unique identifier specific to your bucket only. This will enable us to send the files to the right place
Destination Folder - If you wish to send the exports to place other than the main bucket folder you can specify the path here, sub-folders should be seperated by "/"
Access configuration rule - In order for AT Internet to send the files to your Amazon S3 bucket, your bucket must contain the rule described in the dark grey box in its bucket access configurations. The rule can be easily copy-pasted using the "copy rule" button
Test the connection - when you press the "test the connection" button we will send a small file over to your Amazon S3 Bucket which will enable us to confirm that the information you have provided is correct and the connection has been set up correctly
& hit save!
When you return to the Flow configuration, hit: to refresh the Amazon S3 connection list. You should see the connection you've just configured appear in the drop-down list.
Configuring FTP or sFTP connections
Configuring FTP or sFTP connections is a straight forward process.
Select "FTP" as your send method when setting up to your Data Flow Push Export.
Then select "Add an FTP configuration":
You will be prompted with the following configuration window. In order for to know where to push the Data Flow files and have the necessary rights to send the files AT Internet needs the following information:
Name of the FTP configuration - the information requested here is for your reference. This will enable you to find and edit your connection amongst your other FTP connections you may have configured with AT Internet
IP/Server Name - We need inforation regarding the IP or server name of where your FTP server is located
Protocol - in this section you will be able to specify which protocol you wish to use: FTP or sFTP
Port - In this section you are able to specify which port you would like to use. For FTP connections, port 21 is already pre-selected. For sFTP connections you have choices between ports 2, 23 & 2222
Login & Password - For us to deposit the file we need to have valid login & password details with sufficient access rights
Destination Folder - If you wish to send the exports to place other than the main bucket folder you can specify the path here, sub-folders should be seperated by "/"
Testing the connection - when you press the "test the connection" button we will send a small file over to the FTP which will enable us to confirm that the information you have provided is correct and the connection has been set up correctly.
& hit save!
When you return to the Flow configuration, hit: to refresh the FTP connection list. You should see the connection you've just configured appear in the drop-down list.
FAQ & Technical recommendations
How can I change the Push Export linked to my flow?
A Push Export can be changed by changing the Flow itself - Changes in the Flow will immediately take effect in the linked push export.
How can I delete a Push export linked to my flow?
There are two ways to delete Push Exports:
A Push Export can be delete by deleting the Flow itself.
A push Export can be stopped if it is deleted from the Export management application.
What happens when I delete a flow?
When a Flow is delete from the from Data Flow manager interface, like the Flow itself, the export is valid for 7 more days.
How many push exports can be linked to a flow?
You are able to create one push export for every existing Data Flow.
What formats are the files in?
Push Exports send compressed CSV or JSON files (depending on your configuration) in GZIP format. Before processing the files, you will need to uncompress them. This done within file transfer standards to ensure the fastest and most efficient file transfer possible.
How long does it take for the file to be received?
Please allow for a small delay as the file needs to be generated and transfered after the hour/half-hour is complete. This delay will vary depending on the site traffic.