Common pipeline errors

Prev Next

You may occasionally see errors in pipelines. Use this article to help you troubleshoot some common issues.

Approaches to troubleshooting errors

This section discusses where can you find out about errors and what you can do about them.

Two common types of errors

Here are the common types of errors in pipelines:

Design-time errors

At design-time, pipeline reviews the following:

  • The type of data

  • The context/scope of the data

Problems in these areas can generate an error.

Runtime errors

When your pipeline runs, you may see:

  • Temporary, or transient errors

  • Errors returned from remote systems

Where errors display

You can see errors when you are creating a pipeline (a Design-time error) or when a pipeline runs (a Runtime error).

Design-time errors

In this example, we have an error on a Prepare Bulk Record Upsert:

Because the merge field was of the wrong type, this error message displayed:

Runtime errors

In this example, we don't see an error until the pipeline runs. There is a bad value for the SQL parameter:

and when we ran the pipeline, this error displays:

How to find logs

To view the activity log for a pipeline, click on the three dots next to your pipeline's name on the My Pipelines page:

and click View activity. The log for that pipeline displays:

How to read logs

After your pipeline runs, you'll see details about the pipeline and information about what happened when it ran. Using our example, we can see that an error occurred (Validation error: Invalid date/time value) and details about the input and output that led up to this error:

You'll notice that some messages in the log are in color. We use colors to indicate which data type is involved:

  • red = boolean

  • blue = numeric

  • green = string

  • black = object/null/undefined

In the following examples, you can see how you can use logs to troubleshoot your error.

The most common errors

The following section discusses some common errors and best practices to troubleshoot them.

Third-party errors

Third-party errors can be the easiest type of errors to identify. They usually begin with Remote service… or Remote System…. You can search for these errors in the remote system’s API guide.

Here is an example of an error that could be resolved by searching for the error code.

Text displayed in this error: Remote service reported an error: HTTP status code 404 for URL

3rdparty1.png

Third-party errors

In this example, we see an error that would likely need to be resolved in Sharepoint, rather than pipelines.

Text displayed in this error: Waiting for an Item Created event in Microsoft SharePoint...

3rdparty2.png

Third-party errors

Remote API errors

These errors come from requests from either the JSON handler or Webhook channels and they can be difficult to troubleshoot. Sometimes these errors are straightforward, as in the example below. For more information about API errors, see the API guide.

Text displayed in this error: Remote API returned authentication error: Invalid API key. Please see http://openweathermap.org/faq#error401 for more info.

api1.png

Remote API errors

In this example, a pipeline is using an uncommon encoding type:

Text displayed in this error: {"error":"invalid_client_id","error_description":"Client None is not registered in the system."}"

Remote API errors

Poller errors

These errors can occur for a variety of reasons, but you can use a search tool to help you troubleshoot. The first example is from the Sharepoint poller. Your first step for an error like this one would be to reconnect to Sharepoint in the pipeline editor.

Remote service reported an error: HTTP status code 404 for URL

poller1.png

Poller errors

This error is coming from data in a Google sheet. This error indicates there is an issue with the data on the sheet.

Text displayed in this error: Remote service reported an error: Invalid requests[999]

poller2.png

Poller errors

Invalid pipeline errors

You may see these errors when there is either a conflict or corruption in your pipeline’s YAML. This is often caused if you have edited your pipeline in multiple browser windows or if you deleted a large branch of a pipeline instead of deleting each individual step within your branch. These errors usually can be resolved by copying the pipeline or reimporting the YAML. In a worst-case scenario, you may need to download the YAML from the last successful run as a guide and rebuild the pipeline from scratch.

Text displayed in this error: Invalid Pipeline: Inconsistency detected.

invalid1.png

Invalid pipeline errors

YAML import errors

These errors are caused by a user error on import or because of an issue with a specific type of pipeline structure. Don't copy and paste the YAML from a non-plain text editor and verify that you are using the correct account slugs: the placeholder for the user token/login credentials for that step.

This error below was due to the account slugs not being replaced with the correct ones in a new realm.

Text displayed in this error: Remote API returned authentication error

ymal1.png

YAML import errors

Unattached errors

Some pipeline errors and warnings aren't associated with any particular run ID. Information about the error may or may not appear in the run details. This usually indicates an underlying issue such as a task that didn’t complete properly, etc.

In this example, an error occurs when a ResumePoint isn’t stored when a pipeline run is moved from one task to another in Google Cloud. The pipeline aborts since it doesn’t know where to resume in the run on the new task. In a case like that, you will see an error like this one:

Text displayed in this error: Internal error. Failed to resume execution.

unattached1.png

Unattached errors

If you see a pipeline error that references GCP like this one, open a support ticket.

Warning

This error simply means that the pipeline was hitting the endpoint in Quickbase too quickly and the pipeline slowed down it's execution. These errors aren’t anything to be worried about until the retry is 10/15 or higher. However, this may be an indicator that your pipeline should be optimized for better performance.

Text displayed in this error: Quickbase app is experiencing unusually heavy traffic. Got a transient error from remote system. Retrying (1/15 with 7000ms timeout) with a back-off.

warning1.png

Warning

Warning

Your pipeline may sometimes be throttled to slow down its execution. This is not an error or failure so much as a warning that the pipeline was hitting a Quickbase table too quickly.

Text displayed in this error: Throttling: Pipeline is delayed for 60 s

warning2.png

Warning

Jinja template errors

These errors usually mean that there is something incorrect in your Jinja syntax. However, they can be related to more complicated issues such as underlying data, null values, data type mismatches, etc. In this example, an error was caused by spaces and line breaks in the Jinja template and was resolved once the spaces and line breaks were removed.

Text displayed in this error: Validation error: Incorrect template

jinja.error1.png

Jinja template errors

In this example, we see a misleading data type error that isn’t the true source of the issue. When in doubt, try reformatting and making minor adjustments in your testing of a Jinja expression. Also, see the help topic About Jinja for more information on testing jinja/jinja syntax tips.

Text displayed in this error: Validation error: Incorrect template

jinja.error2.png

Jinja template errors

Restful API errors

These error message can be anything from generic 500 failure errors to something obvious like an authentication error. For more information about API errors, see the API guide.

This error was caused by an extra space after QB-USER-TOKEN XXX-XXXX in the authorization header.

Text displayed in this error: Validation error: 401 Client Error: Unauthorized for url: https://api.quickbase.com/v1/records

restapi1.png

Restful API errors

For help troubleshooting an error like this, see the Errors page in the Quickbase Developer Documentation.

Text displayed in this error: Validation error: 502 Server Error: Bad Gateway for url:

restapi2.png

Restful API errors

Deleted pipeline

This is an error in Quickbase, but it specifically relates to a deleted pipeline that left behind an orphaned webhook in Quickbase. These errors are typically 404 errors. You should first verify that the webhook is orphaned and then delete it. A deleted webhook from a pipeline is automatically recreated when the pipeline is turned off and on again in case you inadvertently delete a webhook for an active pipeline.

Text displayed in this error: Not Found The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.

deleted1.png

Deleted pipeline

CSV data error

This error can occur almost anywhere in a pipeline from Quickbase channels to CSV handler to Onedrive. The error does tend to occur for specific reasons. For example, if there is an error in the CSV handler fetch step, it means that there is either something in the CSV data that the pipeline can’t process (usually UTF-8 characters) or if the file type isn’t a plain CSV. An error in a Quickbase search step it could mean a data set that is too large or special characters are causing an issue. 

Text displayed in this error: Something went wrong executing a step. Try modifying your pipeline.

CSV1.png

CSV data error

Quickbase errors

These errors tend to be the easiest to troubleshoot and test. The example below is a data type mismatch. This error is from trying to input a string into a numeric field.

Text displayed in this error: Validation error: Invalid literal for Decimal: 'Search Problem'

Quickbase errors

This error is from trying to input a non-unique value into a field that is required to be unique.

Text displayed in this error: Remote service reported an error: 51 : Trying to add a non-unique a value to a field marked unique : The field named "Custom Numeric Key" with field id 9 requires a 9 unique value.

qb2.png

Quickbase errors

These are just a few of the many Quickbase channel errors, but you will likely get the hang of these errors faster than all the other types above.

Pipeline call depth exceeded

You see the Pipeline call depth exceeded warning in your log when your pipeline is using the Quickbase or Callable Pipelines channel and has called or triggered itself more than 100 times. You should examine your pipeline and check to see if it has entered a loop.

Unable to show all options

In this example, tables aren't displaying and this error displays:

Text displayed in this error: We're unable to show all options at this time. If you don't see what you're looking for, reload this page. If you need additional support, please contact us.

unable1.png

Unable to show all options

In this situation, try reauthenticating your pipeline’s user token access. See Manage User Tokens for more information.