Package

net.sansa_stack.rdf.spark

io

Permalink

package io

Wrap up implicit classes/methods to read/write RDF data from N-Triples or Turtle files into either DataFrame or RDD.

Linear Supertypes

AnyRef, Any

Ordering

Alphabetic
By Inheritance

Inherited

io
AnyRef
Any

Hide All
Show All

Visibility

Public
All

Type Members

class CustomErrorHandler extends ErrorHandler

A custom error handler that doesn't throw an exception on fatal parse errors.
A custom error handler that doesn't throw an exception on fatal parse errors. This allows for simply skipping those triples instead of aborting the whole parse process.
class JenaKryoRegistrator extends KryoRegistrator

Created by nilesh on 01/06/2016.
implicit class RDFDataFrameReader extends Logging

Adds methods, rdf, ntriples and turtle, to DataFrameReader that allows to read N-Triples and Turtle files.
implicit class RDFDataFrameWriter[T] extends AnyRef

Adds methods, ntriples and turtle, to DataFrameWriter that allows to write N-Triples files.
implicit class RDFReader extends AnyRef

Adds methods, rdf(lang: Lang), ntriples, nquads, and turtle, to SparkSession that allows to read N-Triples, N-Quads and Turtle files.
class RDFSparseTensorReader extends AnyRef

Created by nilesh Build an RDD of (s,p,o) coordinates, with integer IDs starting from 0 for representing URIs Needed for training ML models on knowledge graphs TODO docs
implicit class RDFWriter[T] extends AnyRef

Adds methods, ntriples and turtle, to org.apache.spark.SparkContext that allows to write N-Triples and Turtle files.

Value Members

object ErrorParseMode extends Enumeration
object NTripleReader

An N-Triples reader.
An N-Triples reader. One triple per line is assumed.
object RDFLang extends Enumeration
object WarningParseMode extends Enumeration
package benchmark
package index
package nquads
package ntriples
package rdfxml
package stream
def toRow(nodes: Seq[Node]): Row

Converts a list Jena Node objects to a Spark SQL Row.
Converts a list Jena Node objects to a Spark SQL Row.
nodes
the nodes
returns
the row
def toRow(triple: Triple): Row

Converts a Jena Triple to a Spark SQL Row with three columns.
Converts a Jena Triple to a Spark SQL Row with three columns.
triple
the triple
returns
the row
package turtle

Inherited from AnyRef

Inherited from Any

Ungrouped