Several Enhancements Around Loading CSV and JSON Data
We are continuously working on improving and enhancing our data loading functionalities. Over the last weeks, several new features have been released.
Loading JSON Data within Rel
Most notably, JSON data can now be loaded into your database within Rel as easy as
def config[:path] = "my_data.json"
def json = load_json[config]
and without the need of using an SDK. For more details, please check out our JSON Import and Export (opens in a new tab) tutorial.
Special Characters in CSV Columns Names
We are happy to announce that we support now spaces and many other non-alphanumeric characters in CSV column names. For instance, the file
abbrev.,state name
AL,Alabama
WY,Wyoming
loads now into Rel as any other CSV file.
def mydata = load_csv["/path/to/my/data.csv"]
def output = mydata
(DelveTypes.FilePos(19), :abbrev., "AL")
(DelveTypes.FilePos(30), :abbrev., "WY")
(DelveTypes.FilePos(19), :state name, "Alabama")
(DelveTypes.FilePos(30), :state name, "Wyoming")
To access your CSV column in Rel, use the new stdlib functionality relname_string
.
def output = mydata[_, (col: relname_string(col, "state name"))]
"Alabama"
"Wyoming"
Index CSV data by Row Number
You can now easily index your CSV data with the row number by applying lined_csv
on your loaded CSV data.
def mydata = lined_csv[load_csv["/path/to/my/data.csv"]]
def output = mydata
(1, :abbrev., "AL")
(2, :abbrev., "WY")
(1, :state name, "Alabama")
(2, :state name, "Wyoming")
This replaces the standard FilePos
data type with and the data row number of the CSV file.
Related Posts
RelationalAI Overview
RAI is a cloud-based relational knowledge graph management system, with state of the art probabilistic processing, and declarative reasoning at scale to make developing Data Applications.
Relational Knowledge Graphs
The RAI Knowledge Graph Management System is designed to provide flexibility, scalability, and performance to enable data-centric enterprise Data Apps to be built around Knowledge Graphs.