SSIS Components for JSON

Build 24.0.9060

Vertical Flattening

Vertical flattening queries enable you to retrieve an array of documents as if it were a separate table.

Vertical Flattening Query Syntax

In the FROM clause, you can use dot notation to drill down to a nested array.

SELECT * FROM [people.vehicles] 

Example

Consider the JSON structure from the people collection in Raw Data. Below is an object from the collection:

{
  "people": [
    {
      "personal": {
        "age": 24,
        "gender": "F",
        "name": {
          "first": "Jane",
          "last": "Roberts"
        }
      },
      "vehicles": [
        {
          "type": "car",
          "model": "Toyota Camry",
          "insurance": {
            "company": "Car Insurance",
            "policy_num": "98765"
          },
          "maintenance": [
            {
              "date": "05-11-2017",
              "desc": "tires rotated"
            },
            {
              "date": "11-03-2017",
              "desc": ["oil change","fan belt replaced","coolant reservoir replaced"]
            }
          ]
        },
        {
          "type": "car",
          "model": "Honda Accord",
          "insurance": {
            "company": "Car Insurance",
            "policy_num": "98765"
          },
          "maintenance": [
            {
              "date": "10-07-2017",
              "desc": "new air filter"
            },
            {
              "date": "01-13-2018",
              "desc": "new brakes"
            }
          ]
        }
      ],
      "source": "phone"
    }
  ]
}

Connection String

With the following connection string, the component will not parse nested data -- the data is processed when you execute the query. Due to the default FlattenObjects functionality, the properties of the top-level object are flattened. Nested data is returned as a JSON aggregate.

URI=C:\people.txt;DataModel=Documents;JSONPath='$.people;'

Query

Vertical flattening will allow you to retrieve the vehicles array as a separate table:

SELECT * FROM [people.vehicles]
This query returns the following data set:

insurance.policy_nummaintenancemodeltype
12345[{"date":"07-17-2017","desc":"oil change"},{"date":"01-03-2018","desc":"new tires"}]Honda Civiccar
12345[{"date":"08-27-2017","desc":"new tires"},{"date":"01-08-2018","desc":"oil change"}]Dodge Ramtruck
98765[{"date":"05-11-2017","desc":"tires rotated"},{"date":"11-03-2017","desc":"oil change"}]Toyota Camrycar
98765[{"date":"10-07-2017","desc":"new air filter"},{"date":"01-13-2018","desc":"new brakes"}]Honda Accordcar

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 24.0.9060