Object

net.sansa_stack.rdf.spark.model.hdt

TripleOps

Related Doc: package hdt

Permalink

object TripleOps

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TripleOps
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def asHDT(triple: RDD[Triple]): DataFrame

    Permalink

    Function converts RDD[graph.Triple] to DataFrame [Subject,Object,Predicate] by extracting SOP value from each record

    Function converts RDD[graph.Triple] to DataFrame [Subject,Object,Predicate] by extracting SOP value from each record

    returns

    Returns DataFrame [Subject,Object,Predicate]

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def dictionarySchema: StructType

    Permalink

    Function returns the Schema of Dictionary Dataframe.

    Function returns the Schema of Dictionary Dataframe.

    returns

    Schema of Dictionary

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def getDistinctObjectDictDF(triples: RDD[Triple]): DataFrame

    Permalink

    Return Dataframe of Index + Object by retrieving the unique objects from RDD[Triple] and zip it with undex

    Return Dataframe of Index + Object by retrieving the unique objects from RDD[Triple] and zip it with undex

    triples

    RDD[Triple] conversion of input file

    returns

    DataFrame Object dictionary of [index , object]

  13. def getDistinctPredicateDictDF(triples: RDD[Triple]): DataFrame

    Permalink

    Return Dataframe of Index + Predicate by retrieving the unique predicate from RDD[Triple] and zip it with undex

    Return Dataframe of Index + Predicate by retrieving the unique predicate from RDD[Triple] and zip it with undex

    triples

    RDD[Triple] conversion of input file

    returns

    DataFrame Predicate dictionary of [index,Prediate]

  14. def getDistinctSubjectDictDF(triples: RDD[Triple]): DataFrame

    Permalink

    Return Dataframe of Index + Subject by retrieving the unique subjects from RDD[Triple] and zip it with undex

    Return Dataframe of Index + Subject by retrieving the unique subjects from RDD[Triple] and zip it with undex

    triples

    RDD[Triple] conversion of input file

    returns

    DataFrame Subject dictionary of [index,subject]

  15. def getHDT(triples: RDD[Triple]): DataFrame

    Permalink

    This is key function of TripleOps that read RDF file and create Dictionaries and Index Table and register them as Spark In memory Table

    This is key function of TripleOps that read RDF file and create Dictionaries and Index Table and register them as Spark In memory Table

    returns

    Returns the Tuple4 [IndexDataFrame,SubjectDictDataFrame,ObjectDictDataFrame,PredicateDictDataFrame]

  16. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  17. def hdtSchema: StructType

    Permalink

    Function returns the Schema of Indexed Triple Fact table.

    Function returns the Schema of Indexed Triple Fact table.

    returns

    StructType

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. def readHDTFromDisk(input: String): (DataFrame, DataFrame, DataFrame, DataFrame)

    Permalink

    Read hdt data from disk.

    Read hdt data from disk.

    input

    -- path to hdt data.

  23. def saveAsCSV(hdt: DataFrame, subjectDF: DataFrame, predicateDF: DataFrame, objectDF: DataFrame, output: String, mode: SaveMode): Unit

    Permalink

    Function saves the Index and Dictionaries Dataframe into given location

    Function saves the Index and Dictionaries Dataframe into given location

    output

    Path to be written

    mode

    SaveMode of Write

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped