

You can use the TD Console to configure your connection. Use the Command Line to Create Your Google Drive Connection Name your Transfer and select Done to start.Īfter your transfer has run, you can see the results of your transfer in the Databases tab. TimeZone: supports extended timezone formats like ‘Asia/Tokyo’. Schedule: accepts these three options: custom cron.ĭelay Transfer: add a delay of execution time. In the When tab, you can specify one-time transfer, or schedule an automated recurring transfer. If you want to set a different partition key seed rather than use the default key, you can specify one using the popup menu. Select whether to append records to an existing table or replace your existing table. Complete similar steps to Create new table. You can specify the following parameters:ĭecoders: You can modify the file decoder based on the encode of the file.Ĭhoose an existing source or create a new database and table.Ĭreate a new database and give your database a name. To make changes, select Advanced Settings, otherwise select Next.

Use to import only new, modified files inside the folder since the last import. Incremental Loading: Use when importing data based on a schedule. csv$ # then, a file is skipped if its name doesn’t match with this pattern) (for example, if the file name pattern is. If a file name doesn’t match with this pattern, the file is skipped. Supports only CSV and TSV files or gzip of CSV and TSV files.įilename pattern: Uses regex to match file name. When importing from folder, the folder must contain files of the same type. For example: a folder that contains only CSV files. Import a list of CSV or TSV files or gzip of CSV or TSV files. Use to import only new, modified files since the last import. Modified After: Use to import only a file that is modified after this specified timestamp. ID: File Id from Google Drive. Supports only CSV and TSV files or gzip of CSV and TSV files. Import a CSV or TSV file or you can import a gzip of a CSV or TSV file. Look for the connection you created and select New Source. Transfer Your Data to Treasure DataĪfter creating the authenticated connection, you are automatically taken to the Authentications tab. Repeat the "Create a new connection" step and choose your new OAuth connection. You will be redirected back to TD Console. Log into your Google account in the popup window and grant access to the Treasure Data app.

Select Click here to connect to your Google account. Select Create. You are creating an authenticated connection.Īccess to Google Drive requires OAuth2 authentication. Go to Integrations Hub > Catalog and search and select Google Drive. Use the TD Console to Create Your Connection Create a New Connection Basic knowledge of Treasure Data, including the TD Toolbelt
