Problem Statement
During development, we may be creating and removing fields from our form design. This would eventually lead to having unused columns in the database table. In this exercise, we will discuss how to organize a table structure and eventually remove the unused columns.
For the purpose of this exercise, we will be focusing on the table named sample. In Joget's database, the table name is app_fd_sample.
Understanding the Table Structure
Issue the following SQL to find out the exact structure of the table. With this information on hand, we would be able to better understand what columns are needed to be retained.
mysql> describe app_fd_sample; +------------------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +------------------------+--------------+------+-----+---------+-------+ | id | varchar(255) | NO | PRI | NULL | | | dateCreated | datetime | YES | | NULL | | | dateModified | datetime | YES | | NULL | | | c_attachment | longtext | YES | | NULL | | | c_title | longtext | YES | | NULL | | | createdBy | varchar(255) | YES | | NULL | | | createdByName | varchar(255) | YES | | NULL | | | modifiedBy | varchar(255) | YES | | NULL | | | modifiedByName | varchar(255) | YES | | NULL | | | c_description | longtext | YES | | NULL | | | c_approver_signature | longtext | YES | | NULL | | | c_approver_2_signature | longtext | YES | | NULL | | | c_status | longtext | YES | | NULL | | | c_field1 | longtext | YES | | NULL | | | c_address | longtext | YES | | NULL | | | c_contact | longtext | YES | | NULL | | | c_name | longtext | YES | | NULL | | | c_approval_status | longtext | YES | | NULL | | | c_last_approve | longtext | YES | | NULL | | | c_field2 | longtext | YES | | NULL | | | c_desc | longtext | YES | | NULL | | | c_field3 | longtext | YES | | NULL | | | c_city | longtext | YES | | NULL | | | c_state | longtext | YES | | NULL | | | c_approverUsername | longtext | YES | | NULL | | | c_identification | longtext | YES | | NULL | | | c_query | longtext | YES | | NULL | | | c_result | longtext | YES | | NULL | | | c_country_list | longtext | YES | | NULL | | +------------------------+--------------+------+-----+---------+-------+ 29 rows in set (0.00 sec)
Some obvious column that we should purge would be:-
- c_field1
- c_field2
- c_field3
Understanding the Data
If you are doing this in a production server, then this step is absolutely needed. We should understand the data first before we perform any sort of cleanup/housekeeping. Below is a simple query to return 1 sample row. In a production environment, we should look at the entire dataset.
mysql> select * from app_fd_sample limit 1 \G;
*************************** 1. row ***************************
id: 478407c6-45cc-433a-8684-6f052e9fb5aa
dateCreated: 2020-04-27 09:20:12
dateModified: 2020-04-27 09:20:12
c_attachment: NULL
c_title: NULL
createdBy: admin
createdByName: Hugo Lim
modifiedBy: admin
modifiedByName: Hugo Lim
c_description: NULL
c_approver_signature: NULL
c_approver_2_signature: NULL
c_status: NULL
c_field1: NULL
c_address: NULL
c_contact: NULL
c_name: NULL
c_approval_status: NULL
c_last_approve: NULL
c_field2: NULL
c_desc: NULL
c_field3: NULL
c_city: Austin
c_state: Alabama
c_approverUsername: NULL
c_identification: NULL
c_query: NULL
c_result: NULL
c_country_list: NULL
1 row in set (0.00 sec)
Finding Usages of the Table
By using the query below, we would be able to identify which app is using this table name.
mysql> select appId, appVersion, formId, name, tableName from app_form where tableName = 'sample'; +------------------+------------+----------------------+----------------------+-----------+ | appId | appVersion | formId | name | tableName | +------------------+------------+----------------------+----------------------+-----------+ | bulkUpdateList | 1 | sample | Sample | sample | | bulkUpdateList | 1 | sample_approval | Sample Approval | sample | | bulkUpdateList | 1 | sample_clarification | Sample Clarification | sample | | sampleV5 | 1 | gridTest | Grid Test | sample | | sampleV5 | 1 | sample | sample | sample | | validatorOneYear | 1 | sample | Sample | sample | | vcApp | 1 | sample | Sample | sample | | vcApp | 2 | sample | Sample | sample | | versionSample | 1 | sample | Sample | sample | | versionSample | 1 | sample2 | Sample2 | sample | +------------------+------------+----------------------+----------------------+-----------+ 10 rows in set (0.00 sec)
As we can see from the result, there are 10 forms pointing to the table now.
With this information on hand, we can now manually go to each of the 10 forms and identify which column/field that is still needed and delete the unused field in the form itself.
We can swiftly open up the form in the form builder by putting replacing the parameters as shown in the screenshot below.
Figure 1: Inspecting the form in form builder.