Liquid Data Mapper
Liquid Data Mapper - Convert XML to JSON
This overview demonstrates creating a simple transform to convert XML data into JSON data.
What is Liquid Data Mapper?
Liquid Data Mapper is a powerful data mapping tool that enables you to integrate, map and transform your data between multiple data sources and targets without writing a single line of code.
Extract, Transform, Load (ETL)
Liquid Data Mapper is a flexible data transformation and mapping tool providing the power and flexibility to produce any combination of data mapping, even combining data from multiple sources, without writing a single line of code.
Data Mapper Features
- Provides a graphical visualization of data mapping between multiple data sources and targets.
- Map data fields using an intuitive drag and drop, no coding required UI.
- Support for CSV files, Databases, EDI data, JSON data, Text files, Web Services and XML data.
- Execute transform within Liquid Studio or generate mapping code for use in your own application.
- Step through debugger with breakpoints, stack trace, state and variable watch windows.
- Optionally generate mapping code in XSLT or C#.
- Ideal for integrating with legacy systems.
Example Data Transformation
Liquid Studio Data Mapper provides an intuitive graphical interface for designing data transforms. The transforms can map multiple data input sources to multiple data output targets while performing conditional logic, filtering, string manipulation, statistical functions and much more.
The transformations are ideal for converting legacy data to new data formats, or for inclusion as part of your data pipeline, transforming data between diverse, heterogeneous systems, without writing a single line of code.
Each transform can be executed within the Liquid Studio environment and debugged by single stepping through them to display the internal state of the engine to be viewed, and path of execution.
The transform can also be executed within your own application by generating XSLT or C# source code.
Mapping data between different data formats
Support is provided for a wide range of data stores:
- Databases: Microsoft SQL Server, Oracle, MySQL, PostgreSQL, SQLite, VistaDB
- EDI: EDIFACT and X12
- JSON
- Microsoft Excel
- Text files: Fixed field flat file and CSV file
- Rest and SOAP Web Services: Supports OpenAPI (Swagger) and WSDL Web Services
- XML
Data can be read and written between multiple different data sources and data targets.
Try Liquid Studio and see how we can help you today Free Trial
Database Data Mapping
Database Reader
Once added, the Database reader can be expanded to access tables with constraints/relationships defined within the database.
The Database reader supports Microsoft SQL Server, Oracle, MySQL, PostgreSQL, SQLite, VistaDB data sources, simply use the wizard to connect to your data source. The database schema structure is then represented hierarchical in the data mapper using the relationships and constraints defined within the database. Standard components allow the database results to be sorted, filtered, grouped, aggregated etc.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the Database reader to the transform. The wizard makes it possible to select a data source and then select the data table or view to be used within the transform.
Database Writer
Once added, the Database writer reads its structure from the database schema, representing related tables as child items along with there appropriate cardinality.
The Database writer supports Microsoft SQL Server, Oracle, MySQL, PostgreSQL, SQLite, VistaDB data sources, simply use the wizard to connect to your data source. The database schema structure is then represented hierarchical in the data mapper using the relationships and constraints defined within the database.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the Database writer to the transform. The wizard makes it possible to select a data source and then select the data table or view to be used within the transform.
Simplifies Development & Reduces Bugs Free Trial
EDI Data Mapping
EDI Reader
Once added, the EDI reader can be expanded to access the data within the EDI specification selected.
The EDI reader supports EDIFACT and X12 standards, simply select the appropriate EDI specification using the intuitive wizard, and the EDI document is represented in the data mapper as a hierarchical data source. Standard components allow the EDI data to be sorted, filtered, grouped and aggregated
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the EDI reader to the transform. The EDI specification can then be selected from a list, and any non-standard separators, indicators and terminators can be configured.
EDI Writer
Once added, the EDI writer can be expanded to access the hierarchy of the EDI specification selected.
The EDI reader supports EDIFACT and X12 standards, simply select the appropriate EDI specification using the intuitive wizard, and the EDI target is represented in the data mapper as a hierarchical data target. Connections made to the inputs on the writer will cause data to be copied to the target EDI file.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the EDI writer to the transform. The EDI standard can be selected, as well as providing the ability to configure non-standard separators, indicators and terminators.
Try all the features of Liquid Studio Download Free Trial Now
JSON Data Mapping
JSON Reader
Once added, the JSON reader can be expanded to access the data specified in the associated JSON Schema.
The JSON data mapper component requires a JSON Schema to describe the data being read. If you do not have a schema then one can be inferred from sample JSON documents.
The JSON reader supports the Internet Engineering Task Force JSON Schema Standard.
The JSON source document is represented in the data mapper as a hierarchical data source. Standard components allow the JSON data to be sorted, filtered, grouped and aggregated
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the JSON reader to the transform, you need to specify the JSON schema that describes your data. If you don't have a schema file, then you can infer one from sample JSON data using the JSON Schema Inferring tool. You also need to specify the location where the JSON data will be read from when the transform is executed.
JSON Writer
Once added, the JSON writer can be expanded to access the data described in the associated JSON Schema.
The JSON data mapper component requires a JSON Schema to describe the data being written. If you do not have a schema then one can be inferred from sample JSON documents.
The JSON writer supports the Internet Engineering Task Force JSON Schema Standard.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the JSON writer to the transform, you need to specify the JSON schema that describes your data. If you don't have a schema file, then you can infer one from sample JSON data using the JSON Schema Inferring tool. You can also specify a location where the JSON data will be written to when the transform is executed.
Tools for Designing and Developing XML Schemas Free Trial
Microsoft Excel Data Mapping
Microsoft Excel Reader
Once added, the Microsoft Excel reader shows the structure of the document.
The structure of the data to be read by the Excel data mapper component must be defined before it can be used. This can be a named region or range within the Excel document.
Although the structure of the data read is always flat, a hierarchical structure can be imposed on it using the group by component.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to define the data structure, this can be from a sample or can be user defined or customised as required.
Microsoft Excel Writer
Once added, the Microsoft Excel writer allows formatted data to be written to a target file.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to define the data structure, this can be from a sample or can be user defined or customised as required.
Still not sure? Then try Liquid Studio Free Download Free Trial
Structured Text Data Mapping
Text/CSV Reader
Once added, the Text/CSV reader shows the structure of the document.
The structure of the data to be read by the text data mapper component must be defined before it can be used. If the source data contains headings then this structure can be created from a sample data file. Options provide the ability to specify the formatting of the data (separated or fixed width fields), and separators and other options can be configured. The structure can also be created or modified manually, providing complete flexibility.
Although the structure of the data read is always flat, a hierarchical structure can be imposed on it using the group by component.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to define the data structure, this is automatic if a sample file is provided with headers and data, but can also be user defined or customised as required.
Text/CSV Writer
Once added, the Text/CSV writer allows formatted data to be written to a target file.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to define the data structure, this is automatic if a sample output file is provided with headers and data, but can also be user defined or customised as required.
Like what you see? Try Liquid Studio Free Free Trial
Web Service Data Mapping
REST and SOAP Web Services
Once added, the Web Service Call component shows the structure of the web service.
The Web Service Call component gets the structure of the data from an OpenAPI (Swagger), WSDL, WADL or custom User Defined information. The nested data within the web service can then be accessed by expanding the fields on the Web Service Call component.
The Web Service Call component acts as both a data source and data target.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to infer the data structure from the Web Service.
Try Liquid Studio and see how we can help you today Free Trial
XML Data Mapping
XML Reader
Once added, nodes within the XML reader can be expanded to access the child elements and attributes within the hierarchy of the XML document.
The XML reader gets the structure of the data from an XML Schema (XSD, XDR, DTD) which can be inferred from sample XML data if one is not available. The nested data within the XML document can then be accessed by expanding the fields on the XML Data Source component.
The XML reader supports W3C XSD 1.0, Microsoft XDR, and W3C DTD standards.
The XML source document is represented in the data mapper as a hierarchical data source. Standard components allow the XML data to be sorted, filtered, grouped and aggregated
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the XML reader to the transform, you need to specify the XML schema that describes your data. If you don't have a schema file, then you can infer one from sample XML data using the XML Schema Inferring tool. You also need to specify the location where the XML data will be read from when the transform is executed.
XML Writer
Once added, the XML writer can be expanded to access the data described in the associated XML Schema (XSD, XDR, DTD).
The XML data mapper component requires an XML Schema to describe the data being written. If you do not have a schema (XSD, DTD, XDR) then one can be inferred from a sample XML document.
The XML reader supports W3C XSD 1.0, Microsoft XDR, and W3C DTD standards.
Supported Operations
Once a data reader and writer are connected, it is possible to start graphically building the transform, dragging data from the source to the target.
Wizard
A simple wizard is used to add the XML writer to the transform, you need to specify the XML schema that describes your data. If you don't have a schema file, then you can infer one from sample XML data using the . Then select the root element in the document you want to create and specify a location where the XML data will be written to.
Simplifies Development & Reduces Bugs Free Trial
Data Mapper Component Palette
Data Sources and Targets:
- CSV, Database, EDI, JSON, Microsoft Excel, Text File, Web Service, XML
Transformation Components:
-
Values
- Constant Value
- Input Parameter
- Output Parameter
-
Aggregate
- Average
- Count
- Max
- Min
- Sum
-
Comparator
- Equal
- Greater Than
- Greater Than or Equal
- Less Than
- Less Than or Equal
- Not Equal
-
Date Time
- Create Date
- Create Date Time
- Create Time
- Date Add
- Day
- Hour
- Millisecond
- Minute
- Month
- Now
- Second
- Set Timezone
- Today
- ToLocal
- ToUtc
- Year
-
File
- Combine Path
- Get Directory Name
- Get Extension
- Get Filename
- List Files
- Path Value
- Read File
- Resolve Path
- Write File
-
Logic
- And
- False
- Not
- Or
- True
-
Maths
- Abs
- Add
- Divide
- Is Even
- Is Odd
- Modulus
- Multiply
- Subtract
-
Misc
- Annotation
- If
- Join
- Lookup
- New Guid
-
Set
- Combine
- Distinct
- Filter
- First
- Get At
- Group By
- Last
- Position
- Sort
- Top
-
String
- Base64 Decode
- Base64 Encode
- Char To Code
- Code To Char
- Concat
- Empty To Null
- Hex Decode
- Hex Encode
- Index Of
- Join String
- Left
- Length
- Lower
- Replace
- Right
- Split String
- Sub String
- Text Decode
- Text Encode
- Trim
- Trim End
- Trim Start
- Upper
-
Type
- Cast
- Default If Null
- Is Null
- Node Name
- Node Type
