Deprecated: Function get_magic_quotes_gpc() is deprecated in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 99
Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 619
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1169
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176
Warning: Cannot modify header information - headers already sent by (output started at /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php:99) in /hermes/walnacweb04/walnacweb04ab/b2791/pow.jasaeld/htdocs/De1337/nothing/index.php on line 1176 Supported Log Services | Fivetran platform service documentation and setup
Fivetran Platform Connector is a free connector that delivers your logs and account metadata to a schema in your destination. We automatically add a Fivetran Platform connection to every destination you create. The Fivetran Platform Connector is available on all plans. Learn more in our Fivetran Platform Connector documentation.
The MAR that Fivetran Platform connections generate is free, though you may incur costs in your destination. Learn more in our pricing documentation.
External log services
As an alternative to the Fivetran Platform Connector, you can use any of the following external log services:
You can connect one external logging service per destination. Fivetran will write log events for all connections in the destination to the connected service. If there is a logging service that you would like but that is not yet supported, let us know.
Important user actions and the resulting data modifications generate Audit Trail events.
The three main benefits of the Audit Trail logs are as follows:
Enhanced transparency, accountability, and compliance - they allow users to track important actions and changes, providing a comprehensive history of interactions and data modifications.
Bolstered security and fostered trust - they help identify unauthorized access or suspicious activities, ensuring data integrity and demonstrating regulatory compliance.
Streamlined troubleshooting and improved operational efficiency - they empower organizations to conduct thorough investigations and enhances overall operational effectiveness.
The following table lists all Audit Trail log events along with all of their use cases. Note that some events have multiple use cases, which results in the data object containing use case-specific set of fields. In that case, the use cases are listed in the table under the parent log event. For example, Edit Authentication Generate SCIM Token, and Enable or Disable SCIM are two use cases of the edit_account event.
This section describes the life cycle of a connection. It lists the corresponding log event generated at each stage of the connection, or connection-related dashboard activities. This will help you recognize the events in the logs and understand how their ordering relates to the operations of the connection.
The connection life cycle stages as are listed in chronological order where possible.
1. Connection creation initialized
When you create a connection, Fivetran writes its ID in Fivetran's database and assigns the connection status “New.”
Fivetran writes encrypted credentials in its database.
If you create a connection in your Fivetran dashboard, you need to specify the required properties and authorization credentials.
If you create a connection using the Create a Connection API endpoint, you need to specify the required properties. However, you can omit the authorization credentials and authorize the connection later using the Connect Card.
For this stage, Fivetran generates the following log events:
During these tests, Fivetran verifies that credentials such as authentication details, paths, and IDs are correct and valid, and resources are available and accessible.
After the setup tests have succeeded, Fivetran records the Connection Created user action in the User Actions Log. At this stage, the connection is paused. It does not extract, process, or load any data from the source to the destination.
After the connection has been successfully created, you can trigger the historical sync.
For this stage, Fivetran generates the following log events:
Event name
Description
connection_successful
Successfully established connection with source system
connection_failure
Failed to establish connection with source system
4. Connection schema changed
Connection schema changes include changing the connection schema, tables and table columns.
You change your connection's schema in the following cases:
You need to change a connection schema as part of the schema review. The schema review after you have created a connection and before you run the historical sync is required for particular connector types.
For an un-paused connection, changing the schema will trigger a sync to run. If a sync is already running, Fivetran will cancel the running sync and immediately initiate a new one with the new schema configuration.
5. Sync triggered
You need to run the historical sync for the connection to start working as intended. The first historical sync that Fivetran does for a connection is called the initial sync. During the historical sync, we extract and process all the historical data from the selected tables in the source. Periodically, we will load data into the destination.
After a successful historical sync, the connection runs in the incremental sync mode. In this mode, whenever possible, only data that has been modified or added - incremental changes - is extracted, processed, and loaded on schedule. We will reimport tables where it is not possible to only fetch incremental changes. We use cursors to record the history of the syncs.
Incremental sync runs on schedule at a set sync frequency only when the connection's sync scheduling type is set to auto in our REST API. Setting the scheduling type to manual effectively disables the schedule. You can trigger a manual sync to sync the connection in this case.
For this stage, Fivetran generates the following log events:
Event name
Description
Step
alter_table
Table columns added to, modified in or dropped from destination table
Load
change_schema_config_via_sync
Schema configuration updated during a sync. Updates are done when a new table was created during the sync and the user selected to automatically include new tables in the schema.
Process
copy_rows
Data copied to staging table
Load
create_schema
Schema created in destination
Load
create_table
Table created in destination
Load
delete_rows
Stale rows deleted from main table
Load
drop_table
Table dropped from destination
Load
insert_rows
Updated rows inserted in main table
Load
json_value_too_long
A JSON value was too long for your destination and had to be truncated
Process
read_end
Data reading ended
Extract
read_start
Data reading started
Extract
records_modified
Number of records modified during sync
Load
schema_migration_end
Schema migration ended
Load
schema_migration_start
Schema migration started
Load
sql_query
SQL query executed on a source database
Extract
sync_end
Data sync completed Valid status field values: SUCCESSFUL, FAILURE, FAILURE_WITH_TASK, and RESCHEDULED
Load
sync_start
Connection started syncing data
Extract
update_rows
Existing rows in main table updated with new values
Load
write_to_table_end
Finished writing records to destination table
Load
6. Connection paused/resumed
When you have just created a connection, it is paused, which means it does not extract, process, or load data. After you successfully run the setup tests, the connection becomes enabled/resumed. After the successful initial sync, it starts working in incremental sync mode.
Resuming a connection will trigger either the initial sync, or an incremental sync, depending on the stage the connection was at when it was paused.
7. Re-sync triggered
In some cases you may need to re-run a historical sync to fix a data integrity error. This is called a re-sync. We sync all historical data in the tables and their columns in the source as selected in the connection configuration.
Successful - the sync was completed without issue and data in the destination is up to date.
Failure - the sync failed due to a unknown issue.
Failure with Error - the sync failed due to a known issue that requires the user to take actions to be fixed. An Error is generated and displayed on the Alerts page in the dashboard.
Rescheduled - the sync was unable to complete at this time and will automatically resume syncing when it can complete. This is most commonly caused by hitting API quotas.
Canceled - the sync was canceled by the user.
When the sync ends, Fivetran generates the following log events:
Event name
Explanation
sync_end
Final status of sync.
sync_stats
Current sync metadata. This event is only displayed for a successful sync for the following connectors:
If you set the sync scheduling for your connection to manual, you need to manually trigger your syncs after you make this change. If a manually-triggered sync was rescheduled, you need to manually re-trigger that sync, since sync rescheduling only works with automatic sync scheduling.
10. Connection broken
This is an abnormal state for a connection. It commonly happens due to transient networking or server errors and most often resolves itself with no action on your part.
A connection is considered to be broken when during its sync it fails to either extract, process, or load data.
You can see a connection in the Connection List is broken when it has the red Broken label.
In the Connection dashboard, a broken connection also has the red Broken label.
If we know the breaking issue, we create a corresponding Error and notify you by email with instructions on how to resolve the issue. The Error is displayed on the Alerts page in your Fivetran dashboard. You need to take the actions listed in the Error message to fix the connection. We resend the Error email every seven hours until the Error is resolved.
If the root cause of a connection sync failure is unclear, we display an Unknown Error in your dashboard. If the connection remains in this state for 48 hours, we automatically escalate the issue to our support and engineering teams.
For this stage, Fivetran generates the following log events:
Event name
Description
sync_end
The value of the status field is either FAILURE or FAILURE_WITH_TASK
11. Connection modified
You can change the connection credentials, incremental sync frequency, delay notification period and other connector-specific details of a connection. You can modify the connection in your Fivetran dashboard or by using the Update a Connection endpoint.
For this stage, Fivetran generates the following log events:
Event name
Description
edit_connector
Connection's credential, sync period or delay notification period is edited
Connection schema, sync frequency, details, delay sensitivity, or status changed
After you have modified and saved your connection, Fivetran automatically runs the setup tests.
12. Connector deleted
When you delete a connection, we delete all of its data from Fivetran's database. You can delete connections both in your Fivetran dashboard and by using the Delete a Connection endpoint.
For this stage, Fivetran generates the following log events:
"data":{"id":"rivalry_occupier","name":"core-v2-cron_0_8","startTime":"2024-12-18T16:57:41.671Z","transformationType":"DBT_CORE","schedule":{"type":"cron","entries":["*/3 * * * *"]},"endTime":"2024-12-18T16:58:43.323Z","result":{"stepResults":[{"step":{"name":"a_step_1_1","command":"dbt run --select +modela","processBuilderCommand":null},"success":false,"startTime":"2024-12-18T16:57:51.671Z","endTime":"2024-12-18T16:58:38.323Z","commandResult":{"exitCode":1,"output":"16:57:54 Running with dbt=1.7.3\n16:57:55 Registered adapter: bigquery=1.7.2\n16:57:55 Unable to do partial parsing because saved manifest not found. Starting full parse.\n16:57:56 Found 3 models, 1 source, 0 exposures, 0 metrics, 447 macros, 0 groups, 0 semantic models\n16:57:56 \n16:58:37 Concurrency: 7 threads (target='prod')\n16:58:37 \n16:58:37 1 of 1 START sql view model test_schema.modela .................................. [RUN]\n16:58:37 BigQuery adapter: https://console.cloud.google.com/bigquery\n16:58:37 1 of 1 ERROR creating sql view model test_schema.modela ......................... [ERROR in 0.35s]\n16:58:37 \n16:58:37 Finished running 1 view model in 0 hours 0 minutes and 40.91 seconds (40.91s).\n16:58:37 \n16:58:37 Completed with 1 error and 0 warnings:\n16:58:37 \n16:58:37 Database Error in model modela (models/modela.sql)\n Quota exceeded: Your table exceeded quota for imports or query appends per table. For more information, see https://cloud.google.com/bigquery/docs/troubleshoot-quotas\n compiled Code at target/run/test_schema/models/modela.sql\n16:58:37 \n16:58:37 Done. PASS=0 WARN=0 ERROR=1 SKIP=0 TOTAL=1","error":""},"error":null,"successfulModelRuns":0,"failedModelRuns":1,"modelResults":[{"name":"test_schema.modela","errorCategory":"UNCATEGORIZED","errorData":null,"succeeded":false}]}],"error":null,"description":"Steps: successful 0, failed 1"}},
fields
description
id
Job ID
name
Job name
startTime
Job run start time
transformationType
Job type (DBT_CORE, QUICKSTART, DBT_CLOUD or COALESCE)
schedule
Job schedule
endTime
Job run end time
result
Result details
stepResults
Step results
step
Step details
name
Step name
command
Step command for DBT_CORE
processBuilderCommand
Step command for QUICKSTART
success
Boolean specifying whether step was successful
startTime
Step run start time
endTime
Step run end time
commandResult
Command run result details
exitCode
Command exit code
output
Command output
error
Command execution errors
error
An exception message that occurred during step execution
successfulModelRuns
Number of successful model runs
failedModelRuns
Number of successful model runs
modelResults
Model run results
name
Model name
errorCategory
Model error category
errorData
Model error data
succeeded
Boolean specifying whether model run was successful
error
Error message if the job failed outside of step execution
"data":{"message":"Data access granted for 21 days.","ticketId":"123456","destinationName":"destination","connectionName":"facebook_ads","actor":"actor"}
fields
description
message
Diagnostic data access message
ticketId
Zendesk support ticket number
destinationName
Destination name
connectionName
Connection name
actor
Requester name as specified in Zendesk
diagnostic_access_granted
"data":{"message":"Data accessed by Fivetran support for diagnostic purposes","connectionName":"connector","destinationName":"destination","requester":"requester-name","supportTicket":"1234"}
DELAY_NOTIFICATION_PERIOD - Change of delay notification period
DELAY_NOTIFICATION - change of delay notification
UPDATE_DATA_SENSITIVITY - change of data sensitivity
UPDATE_SETUP_STATE - Change of connection or setup status
id
Connection ID
properties
Connector type-specific properties
oldProperties
Changed connection type-specific properties
extract_summary
The object field of the extract_summary log event is not available for all connectors. If you need a specific connector to support this log event, submit a feature request.
The overall status of the query operation. Possible values: SUCCESS, FAIL
total_queries
Total count of API calls
total_rows
Total number of rows extracted
total_size
Total size of the data extracted in bytes
rounded_total_size
A human-readable format of the total size. The value is rounded down to the nearest unit. For example, if the size is 3430KB, the number is rounded to display 3MB. The same logic applies to round to KB or GB, whatever the nearest unit is
objects
An array of objects. Each object contains an aggregation template designed to consolidate similar API calls into a single count
"data":{"schema":"hubspot_test","table":"ticket_property_history","reason":"Ticket's cursor is older than a day, triggering re-sync for TICKET and its child tables.","cause":"STRATEGY"}
"data":{"query":"SELECT OBJECT_SCHEMA_NAME(sc.object_id) as TABLE_SCHEMA, OBJECT_NAME(sc.object_id) as TABLE_NAME, sc.name as COLUMN_NAME, sc.column_id, ISNULL(TYPE_NAME(sc.system_type_id), t.name) as DATA_TYPE, COLUMNPROPERTY(sc.object_id, sc.name, 'ordinal') as ORDINAL_POSITION, CONVERT(nvarchar(4000), OBJECT_DEFINITION(sc.default_object_id)) as COLUMN_DEFAULT, ISNULL(TYPE_NAME(sc.system_type_id), t.name) as IS_NULLABLE, COLUMNPROPERTY(sc.object_id, sc.name, 'octetmaxlen') as CHARACTER_OCTET_LENGTH, convert(tinyint, CASE WHEN sc.system_type_id IN (48, 52, 56, 59, 60, 62, 106, 108, 122, 127) THEN sc.precision END) as NUMERIC_PRECISION, convert(int, CASE WHEN sc.system_type_id IN (40, 41, 42, 43, 58, 61) THEN NULL ELSE ODBCSCALE(sc.system_type_id, sc.scale) END) as NUMERIC_SCALE FROM sys.columns AS sc LEFT JOIN sys.types t ON sc.user_type_id = t.user_type_id LEFT JOIN sys.tables as tbs ON sc.object_id = tbs.object_id WHERE tbs.is_ms_shipped = 0","number":5,"executionTime":44}
fields
description
query
SQL query
number
Serial number of SQL query run against the source within sync
If status is FAILURE, this is the description of the reason why the sync failed. If status is FAILURE_WITH_TASK, this is the description of the Error. If status is RESCHEDULED, this is the description of the reason why the sync is rescheduled.
taskType
If status is FAILURE_WITH_TASK or RESCHEDULED, this field displays the type of the Error that caused the failure or rescheduling, respectively, e.g., reconnect, update_service_account, etc.
rescheduledAt
If status is RESCHEDULED, this field displays the scheduled time to resume the sync. The scheduled time depends on the reason it was rescheduled for
sync_stats
The sync_stats event is only generated for a successful sync for the following connectors: