Frequently Asked Questions¶

How long will it take to get reflected for a file/table added, to be used in Qualdo?¶

Qualdo will look for the files/tables in the configured Datasource for every 20 mins. The schedule starts as soon as the Datasource is configured. So if you added a Datasource let’s say at today 10.00 a.m, then Qualdo will look for the newly added files/tables next at 10.20 a.m.

What is the frequency in which Dataset discovery happen?¶

Dataset discovery happens once in every 20 mins.

Can I add same Datasource multiple times?¶

No you cannot add same Datasource multiple times. But in case of filesystem, you can add different different folders as different Datasources by mentioning folder name in the subpath, each time you are configuring the Datasource.

Already a file was added in a bucket. In the same bucket, added one more file and configured Datasource, it came ‘data already exist’.¶

You are trying to add same Datasource twice, which is not allowed in Qualdo. If you add files in Azure Blob Storage / Azure DataLake. There is no need to add the Datasource again. Qualdo will internally discover newly added file.

How long I have to wait to visualize the quality issues in my data after configuring Datasources?¶

For the first time it will take upto one hour for the first Dataset to get proccesed from the time Datasource has been configured. To proccess the other Datasets present in the configured Datasource it will take maximum of 25 minutes each. So you have to wait for 60minutes(for 1 Dataset) + (n) * 25 mins to visualize the quality issues in your data. The progress can be tracked at the grid present at the end of the Configure -> Datasources tab.

Can I add same Datasource in multiple environments?¶

Yes, you are allowed to add same Datasource in different environments.

Can I use the same JSON file to upload Datasources of different types?¶

Yes, you can use the same JSON file to upload Datasources of different types, provided the JSON have valid entries.

Does Qualdo support nested JSON?¶

No, Qualdo only supports flattened JSON.

Are SSL connections supported?¶

No, currently we don’t support.

Can I edit the definition of a Data Quality Metrics for a particular Dataset alone?¶

No, when you edit the Default Data Quality Metrics definition, then it will be applied on all the Datasets from the next refresh. You can write Custom Query to have specific metrics computation on a particular Dataset.

Is it possible to disable/enable the monitoring of any Default Metrics in a need basis?¶

Yes, you can enable or disable the monitoring of any Default Metrics by clicking on the Play button present on the metrics card.

Can I write a query involving more than one Dataset in SQL query, while creating Data Quality Metrics?¶

No, we don’t support that.

How are credentials handled after they’re configured with Qualdo?¶

All credentials used to access other systems (i.e., your database or a SaaS integration) are encrypted before we store them.

Will Qualdo requires full access on the Datasources? If so why?¶

Yes. Qualdo requires Read & Write access on the Datasource. Read access is required to read data to process and identify the errors in it. In order to write the error data back to the Datasource system, Qualdo requires write access.

How many team members can be in a team?¶

There is no limit.

Who will receive invoices?¶

Admin will be receiving the invoice.

What are the permissions a team member will have?¶

We have two types of roles assigned to the team members.

Admin
Data Scientist

What you see will depend on what role you are given when you join the team.

If I face any issue how do I report?¶

For any issues faced within Qualo, you can reach out to the support team via the helpdesk option available in the product. Click on the Question mark (?) icon present at the right top or click on the Help Desk option available under User icon and chat with the agent if available online or raise the issue with the screenshot attached.

Can I configure multiple emails for alert notification?¶

Yes, you can configure multiple emails for alert notification.

Can I have different notifications and pipeline channels for an alert?¶

Yes, you can configure different notifications and pipeline channels for an alert.

Where can I track my usage?¶

You can go to Plan & Usage section under the User menu (your icon) to view your Plan Details and Usage.

Usage is for active data or includes histories too?¶

Usage is for the data processed by Qualdo so far, in the current billing month.

What is blip and sudden referenced in monitor page?¶

Blip and Sudden refers to the error trend in the metrics value. Blip - When the error pattern looks like triangle or inverted V. Sudden - When the error pattern has fall or rise at a point and continue to be straight line.

Fill Rate 25% to 50%. What does this mean?¶

What is the percentage of data contributing to Fill rate range btw 25% to 50%

Can I choose a particular column and a Dataset of my choice to see fill rate?¶

Yes, you can.

Whether the recency attribute refers to the time when the file was considered for data refresh or the time the file was uploaded to Azure blob?¶

Modified time of the file at the time of data refresh is considered. When the modified time of file in the current refresh is different from modified time of the file considered at the previous refresh, then it is a recent data. When the modified time is not changed, there will be an impact in the recency metrics.

How outlier is identified? What is the threshold Qualdo keeps to define on what is the outlier?¶

For every numerical attribute, based the mean and standard deviation of the attribute, Qualdo will arrive with the lower & upper limits. The values not lying within lower and upper limits will be the outliers.

How is the billing cycle considered in Qualdo?¶

Start date + no. of days in current month is considered for monthly billing cycle. 365 days is considered for annual billing cycle.