Skip to content

varkhan/VCom4j

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

VCom4j

Varkhan Commons for Java

High performance Java constructs and datastructures for very large datasets.

Mission

VCom4j provides dedicated datastructures, frameworks and constructs to facilitate in-memory processing of very large datasets (Gbs to Tbs per node), that combine an optimized memory footprint, low latency and high throughput.

Packages

  • Base General purpose datastructures and constructs (no cross or external dependencies)

    • Containers Container-type datastructures (lists, sets, maps, trees, tries, queues)
    • Conversion Format conversion, (en/de)coding and (de)serialization
    • Extensions Language extensions, typing and syntactic tools
    • Functors Functional primitives and frameworks
    • Management Configuration, logging and monitoring constructs
  • Core Extended functions on specific data types or environments (depends only on Base modules)

    • Concurrent Thread-safe datastructures
    • Geometry Geometry data representation, search and storage
    • Presentation Visual rendering primitives and frameworks
  • Data Data-storage and data-processing frameworks (depends on Base and Core modules)

    • Learning Machine-learning primitives and algorithms
    • Linguistics NLP and character data analysis structures
    • VisualDiff Change detection and comparison algorithms
  • Serv Serving and monitoring frameworks (depends on Base and Core modules and external libraries)

Building

For each $module, invoking

ant -f $module/build.xml clean compile test artifact

will build source, bytecode and documentation jars in the local $module/lib directory.

Adding an extra publish target to the above line will publish to the local repo, by default .ivy/dist in the project root.

Distribution and licence

This set of libraries is distributed under LGPL v2.1. Please refer to LICENSE.txt for detail.

Releases

No releases published

Packages

No packages published

Languages