As of Looker 4.6, you can schedule reports directly to an SFTP server. Results can be unlimited, allowing users to schedule and send large result sets, provided they meet the streaming criteria (that is, the report can’t contain table calculations or totals or, in some dialects, pivots). The scheduler will let you know as you’re scheduling if the report can be unlimited or not. To see this option in the scheduler modal, the user needs to have the
When to Schedule to SFTP
Similar to sending results to S3 (discourse), sending results to an SFTP server works well when results are too large to send directly via email. Because Looker uses Sendgrid to process scheduled emails, and Sendgrid has a 19.5MB size limit (as of November 2016), the reports Looker sends via email have to be limited in size. Streaming to an SFTP server allows customers to bypass browser, memory and email limitations.
Additionally, scheduling results to an SFTP server allows customers to send large result sets from Looker to an SFTP server that can then securely pass those results to third parties. You could, for example, generate a report in Looker and schedule a CSV to be delivered daily to an SFTP server that could forward the CSV to vendors.
#How It Works
Create a schedule for a saved Look or Dashboard.
Select ‘SFTP’ from the ‘Destination’ dropdown (the user needs to have the
send_to_sftppermission to see this)
Enter the URL of the server that you want to send results to
NOTE: the path should end with “/”
sftp://sftp.server.com/home/user123/ NOT sftp://sftp.server.com/home/user123
Enter SFTP credentials
Select ‘Save All’ or send a test via ‘Send Test’ (‘Send Test’ also works for sending a one time email)
You can find a list of IP addresses to whitelist on your SFTP server here. They are the same ones used for secure database access.
Have a great idea for ways that this feature can be used? Post details below to give ideas to others in the Looker community!