# Advanced Dataset Upgrade

{% hint style="danger" %}
**PLEASE READ CAREFULLY. THIS ISSUE CAN CAUSE SERIOUS UNDESIRED DATA TRANSFER.**
{% endhint %}

## Introduction

In the ServiceNow Zurich release, ServiceNow introduced a new Advanced field on the `sysauto` table. Because Unifi Datasets extend this table, this new platform field now overlaps with Unifi’s original Advanced (`advanced`) flag.

As a result, in current versions of Unifi (prior to 4.4), there is a risk that Datasets not marked as Advanced may be reclassified as Advanced by ServiceNow based on their run type. If this occurs and no Advanced query is present, the Dataset may attempt to perform an unfiltered export.

Unifi 4.4 resolves this conflict by introducing a new internal field: Advanced query (`x_snd_eb_advanced`).

## What's new in Unifi 4.4

### **1. New Dataset field: Advanced query (`x_snd_eb_advanced`)**

This field replaces Unifi’s use of the legacy `advanced` flag and cleanly separates Unifi’s Advanced query logic from the Zurich platform field.

### **2. Automatic alignment of existing Datasets**

A Fix Script runs immediately after upgrading to 4.4. It:

* Finds all existing Datasets where the legacy Advanced (`advanced`) field is true
* Sets the new Advanced query (`x_snd_eb_advanced`) field to true
* Makes no other changes to Dataset logic

This ensures Unifi continues to function as before, without interference from the Zurich platform field.

### **3. Advanced query validation (safety check)**

To prevent accidental full exports:

* If a Dataset is marked as Advanced (via the new field)
* But no Advanced query is defined\
  → Unifi will block execution and report a validation error.

This ensures Dataset behaviour remains predictable and prevents unintended bulk exports.

## **Risks in pre-4.4 versions**

If you upgrade to Zurich before upgrading Unifi:

* ServiceNow may automatically treat certain Datasets as *Advanced*
* This depends on the Dataset run type applied by the platform
* Because no Advanced query exists for these Datasets, an unfiltered export may occur

This behaviour does not originate from Unifi; it results from the Zurich platform logic applied to `sysauto.advanced`.

## **Upgrading**

We strongly recommend upgrading to Unifi 4.4 before upgrading to Zurich. This ensures all Dataset records are safely aligned before Zurich applies its new logic to `sysauto.advanced`.

If you upgrade to Zurich before upgrading to Unifi 4.4, there is a risk that data will be exported without the intended filters in place.

In either case, as a precaution, please follow these suggested steps to avoid any issues:

* Turn off all dataset integrations before upgrading the instance
* After the upgrade, ensure that the new "Advanced query" flag is set correctly for each dataset (it will be in the same place that the old "Advanced" flag was)
* Re-enable each dataset integration

## Support

If you have any further questions or require assistance, please contact [ShareLogic Support](https://support.sharelogic.com/).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.sharelogic.com/unifi/install/advanced-dataset-upgrade.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.