This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

What's new in DIH v3

When upgrading the Data Integration Hub (DIH) from version 2.8 to version 3.0, please note the following configuration changes:

Architecture

  • Upgraded to Angular 17
  • Upgraded to Java 17
  • Separate JAR files for ILM and Core DIH

Functionality

  • You can now directly import a schema from a source.
  • A Task now displays all parameters coming from the Executable along with their default values.
  • The Run Status Tree and messages have been unified and can now be filtered.
  • Queries have been optimized to enhance the loading speed of the table mapper group and tables.
  • You can now insert a new setting without needing to connect to a database.
  • A skip and pause functionality has been added to the Task Scheduler.
  • APIs are now supported as data sources, allowing for custom payloads and callback scripts.
  • You can now create fully executable processes using Groovy.

Look and Feel

  • A dashboard providing a quick overview of system health has been introduced.
  • Accordions have been removed. Clicking on an entity now displays details.
  • Entity details now feature editable fields.
  • Specialized editors with built-in support for SQL, JSON, XML, and Groovy have been added.
  • The menu has been reorganized. All application-related menus are now part of the side navigation, while security-related menus can be found in the user profile.
  • Creation and modification details are now available at the entity level.
  • All tabular views now include filters.
  • Executables are now defined using metadata.
  • Mapping expressions open in a popup, allowing you to select fields for mapping without needing to scroll up or down.

1 - Release Notes

1.1 - 2025 Release Notes

This release notes documentation contains package updates and the list of new features and fixed issues for the Data Integration Hub (DIH).

Data Integration Hub 3.1.0

Release Date: 08 August 2025

New Enhancements

This section provides the list of new features and enhancements that have been added in this release.

Category Description
API An entity with multiple roles now returns a list of entity-role mappings, with each role represented in a separate row.
API, Task The GET API of an executable now includes the valueType and validValues in the response.
Executable A new valueType has been introduced to determine whether a parameter is pre-defined or a text field. A parameter with a pre-defined valueType will display a dropdown listing all valid options.
Executable The Code page has been expanded to remove the blank space below it.
Filter All columns now have filters that enable you to show or hide data as needed.
Java The property disableJdkValidation was added to ria-boot.properties, allowing web and runtime servers to validate whether the Java version being used is supported.
Report Search and Sort by fields have been removed and replaced with sort and filter functionalities found in the column headers.
Report Vertical and horizontal scrollbars now appear when columns or rows exceed the visible area.
Run Status The response time for run status messages is now quicker.
Run Status The runsV2 APIs now support the offset and count parameters, which enable pagination.
Run Status The Start Time column in the Job Summary table now uses the DD/MM/YYYY HH:MM:SS AM/PM format.
Run Status The vertical scrollbar now appears when the number of rows exceeds the visible area in the Run Status of a UI job.
Table Mapper A clone option has been added to the header and the Actions column for both the Group and Table.
Target The Source Id specified for a target now includes a link that, when clicked, displays the source details.
Task If the valueType of a parameter is boolean, clicking once on the Mapping Expression column will show a dropdown menu with options for true and false. If the parameter includes validValues, a single click on the Mapping Expression column will display a dropdown listing all the valid options. Additionally, double-clicking will open a dialog that allows you to drag and drop fields.

Fixed Issues

This section provides the list of issues that have been fixed in this release.

Category Description
Entity Roles Fixed an issue where the Save button remained enabled after deleting a newly added role.
Executable Fixed an issue where the BlockComponents of the GroovyTimedExecutor were not populated with any values.
Executable A Parameter ID already exists error message now appears when creating a duplicate parameter ID.
Executable The description of the title parameter is now displayed.
Login Fixed an error where Cannot invoke 'com.ria.core.auth.roleBased.model.AuthUser.getUserEntityRoles()' because 'this.authUser' is null error message is displayed when accessing the application via a copied URL in a different browser.
Report The Table Differences Report and Table Definitions are now loading correctly and include functional scroll bars.
Report Fixed issues with the sorting and scrolling features in the report list.
Report Fixed the alignment of date pickers and text boxes.
Report The Card view toggle button is now fixed in the header and does not overlap with the report cards.
Report The promptOnOpen setting no longer uses cached values. It is now required to click Apply to view the report details. Additionally, the Refresh button has been hidden from the Report view.
Role Maintenance Fixed an issue where tab switching did not work on the first Enter key press after pressing the left arrow key.
Role Maintenance Fixed an issue where the tab automatically switched after selecting an item from the Role dropdown and pressing Enter.
Role Page Fixed an issue where a component ID with a # character only passes the portion before #.
Run Status Fixed an issue where console logs did not appear when using certain time zones, such as UTC-8 Pacific Time (US & Canada).
Run Status Fixed an issue where selecting the Forgot checkbox also ticked the Select checkbox.
Settings The vertical scrollbar now appears in the Properties tab of the Database Context page when the list of properties exceeds the visible area.
Settings The Apply button for confirming the selected filter has been added to the filter popup display.
Table Fixed an issue where a selected table was not deleted after selecting Delete from the header menu.
Table Mapper Fixed an issue where a selected table was not deleted after selecting Delete from the header menu.
Table Mapper Fixed an issue where the Save button remained disabled after modifying a table with a name starting with $.
Table Mapper The total number of items in the Group tabs under the Table Mapper - Table page is now consistently displayed at the bottom of the page.
Table Mapper The Comments column in the UA_TM_TABLE_MAP is now visible and editable.
Table Mapper A horizontal scroll bar has been added to the Actions tab, allowing users to view additional columns on the left.
Table Mapper The Clone button in the Table Mapper is now keyboard-accessible and responds to both the Enter and Spacebar keys in accordance with accessibility standards.
Task Fixed issues with filtering and auditing information in the Task module.
Task Fixed an issue where the restore icon in the Action column appears even when no changes have been made.
Task Fixed an issue where clicking the Save button after the restore icon displays a Task Id: value is required message.
Task The newly created empty task parameter row now stays expanded, allowing for easier entry of missing details.
Task Scheduler The SSO logout API method in the Task Scheduler is now working properly.

Data Integration Hub 3.0.0

Release Date: 30 April 2025

New Enhancements

This section provides the list of new features and enhancements that have been added in this release.

Category Description
Automated Unit Tests The schema definitions for Junits have been refactored to eliminate dependencies on external services, using hard-coded JSON responses for offline compatibility, with only the Oracle database required. Key improvements include parameterizing generic types, handling non-200 responses with exceptions, and dynamically toggling the DISABLE_GROOVY_SANDBOX property, along with adjustments to prevent unexpected JVM shutdowns during tests.
Executable The getCodeBlockType and populateCodeBlockFromCodeBlockComponents methods now use an if-else-if structure to refer to class names instead of using literal strings.
Executable The String.equals method is replaced by the == operator for more accurate comparisons.
Executable The default parameter values in the DefaultReportExecutor have been updated.
Executable Removed all @ExecutableParam annotations from the SQLScriptWorkEntryExecutor class, as it does not have any internal parameters.
General DIH now shows years using the standard calendar year instead of the ISO year-week calendar.
General The field is now indicated in error messages when a required value is missing.
Run Status A task tree is now always displayed in an expanded view, even when a different task is selected.
Run Status Inactive targets are now shown as inactive in the Run Status module.
Runtime Server A JdbcStatementTiming Hazelcast IMap is now available to track execution timings for SQL statements on a per-thread basis across JVMs. Additionally, a new UA_SIGNAL table can now be used to log JDBC timing details.
Runtime Server The com.ria.converter.domain.maintenance.service.ormbBaseUrlRegex property is now optional, so it does not prevent startup if it is not specified in the ria-boot.properties file.
Scheduler The steps for handling errors have been updated to include functionality for skipping steps, as well as options for pausing before and after each step.
Security Updated SSO jars in the DIH package that were flagged as vulnerable.
Service You can now modify the pre-filled SWAGGER_URL field in the dialog before invoking the connection.
Target You can now provide any JSON payload directly for use in API calls without conversion. To facilitate this, new parameters have been introduced for OHI integration. The customPayload parameter allows you to use a source payload directly or generate it through a Groovy method while maintaining its JSON formatting. Additionally, the payloadColumn parameter allows you to customize the source column for selecting the payload.
Target When a source ID is entered in the Source Id field, it is now automatically converted to uppercase.
Target, Executables External database access is now supported for TABLESET target mappings. This enhancement improves data handling through the SQLSetWorkEntryExecutor executable.
Task Parameters configured with default values in an executable are now listed in the task associated with that executable.
Task You can now modify the values of the parameters from the associated executable in the Task module. The new values are only saved in the Task module and do not affect the value configured in the Executable module.
Task New parameters that are not defined in the associated executable can now be added in the Task module. The new parameters are only saved in the Task module and do not affect the Executable module.
Task Scheduler The Oracle DBMS scheduler can now be used to skip or pause steps in a chain in the Task Scheduler UI.
Timed Task User activity logging has been implemented to specifically track who initiated and completed each timed task.

Fixed Issues

This section provides the list of issues that have been fixed in this release.

Category Description
Executable Fixed an issue where the handleDefaultReportExecutor method does not return the correct data chart.
Executable Fixed an issue where the handleDefaultReportExecutor method checks for chartDef instead of chartDefs and verifies component names for menu and groovy rather than their labels.
Executable The parameter annotations for SQLScriptWorkEntryExecutor and FileUploadWorkEntryExecutor have been removed.
Executable Fixed an issue where the save prompt does not appear when navigating away after adding a new parameter or changing the target type of an executable.
Executable Fixed an issue where the executable list did not display the second entry or the previous entry when deleting a top or last entry, respectively.
Executable Fixed an issue where the Delete Code Block prompt appeared when deleting a code block before clicking the Save button.
Executable Fixed issues with the alignment and spacing between columns in the Code tab.
Executable Fixed an issue where the validationType parameter annotation is in the ValidationExecutor instead of ValidationWorkEntryExecutor.
Executable Fixed an issue where the ; at the end of the SQL statement cannot be added and was automatically removed after clicking the Refresh button.
Executable The Expand SQL button is now displayed in the Row Data and Chart Data tabs.
Executable Fixed an issue where the Discard changes? dialog appears when switching between executables without modifications.
Executable, Task Fixed an issue where newly created executables do not appear in the Executable Id dropdown list when creating a new task.
Package Builder Fixed an issue that prevented a shutdown after executing a chain export or import.
Report Fixed issues with the sorting and scrolling features in the report list.
Report A scroll bar has been added to the Reports list, enabling you to view additional reports across different pages.
Report Reports can now be correctly sorted and filtered.
Report Fixed an issue where using the back button after navigating to a linked report would display the report menu instead of the original report.
Run Status Fixed an issue where the Ended in error status is displayed for a running job.
Run Status The link between run status and task is now working properly, even with an active filter.
Run Status, Task Fixed an issue where, during a job chain restart, only the parameters of the first pending task were updated, causing subsequent tasks with corrected parameters to still fail. The restart process now updates parameters for all pending tasks in the chain.
Service Fixed an issue where the Swagger import dialog automatically connects to the SWAGGER_URL.
Service Unsupported languages have been removed from the Code Editor Language dropdown list.
Service Updated the swaggerURL Java method to return a NOT_FOUND error message when the SWAGGER_URL setting cannot be found, instead of throwing any exception errors.
Source Columns specified in a groupingKey will only be automatically included in the ORDER BY clause when the source is a table. If a groupingKey is specified for a query source, a validation has been added to ensure that the ORDER BY clause includes the correct columns. This validation can be disabled using the disableGroupingKeyValidation parameter.
Source Fixed an issue where the Save button gets disabled when a Primary Key checkbox is selected.
Source, Target Fixed an issue where a NullPointerException occurs when a grouping key is specified for a target, but the source does not select any data.
Table Fixed an issue where the Save button remained disabled after a column was removed by dragging it from right to left.
Target Fixed an issue where a GET request from a Target definition would result in a 400 response due to the GenericHttpConnectionImpl class writing to the output stream instead of retrieving the response from the input stream.
Target Resolved a minor memory leak by ensuring that the buffered reader is closed properly in the error response code within the GenericHttpConnectionImpl.
Target Fixed an issue where the entered node names are converted to uppercase.
Target Fixed an issue where the filter changed to match the newly added target after specifying a filter with no matches and then creating a new target.
Target The format in the editor dialog is now Text when editing the comments field on a field mapping.
Target The scroll in the Target Id dropdown list is now displayed and working properly.
Target Fixed an issue where all targets were shown when entering a search keyword without matching targets.
Target Mapping expressions can now be modified.
Target Fixed an issue where the target list collapses when navigating to another module after applying a filter.
Target Fixed an issue where the initially selected target from the filter list remained displayed even after changing the filter and selecting a new target.
Target Fixed an issue where only the first 100 sources were shown in the Source ID dropdown list.
Target Fixed an issue where an error message is displayed when manually adding a child node.
Target The field name is now displayed in the Mapping expression popup editor dialog.
Target Fixed an issue where a child node vanished after modifications were saved.
Target A node list will now expand or collapse only by clicking the icon.
Target Fixed an issue where the service mappings tree did not load correctly when selected from a list.
Target Fixed an issue where a discard changes prompt is displayed even if no changes had been made.
Target The header of the parameter table is now fixed at the top for better visibility.
Task Fixed an issue where a timed task would not run if a prior timed task was cancelled or restarted.
Task Fixed an issue where selecting a task with a Targets tab would incorrectly open the Parameters tab instead of the Targets items. The Add button now correctly adds new Targets to the selected task.
Task The Target Id field is now read-only and cannot be modified after saving a task.
Task Fixed an issue where the Code Details page displays tasks without data blocks.
Task Unsupported languages have been removed from the Code Editor Language dropdown list. The default and only language left is TEXT.
Task Fixed an issue where a newly created target does not appear in the Target Id dropdown until you log in again.
UI Fixed an issue where the same error message is displayed when clicking the Go back button on the popup window.
User Maintenance Fixed an issue where the encrypted password was reencrypted when the associated user name was modified.