Archive for the 'internships' Category

MDE plans for LStore

Model Driven Approach for Distributed Storage Management:

1) A Generic Policy Management framework that will enable to define storage permissions, policies
(for placement, caching, replication, migration, weaver-erasure, bandwidth allocation strategies).
A Policy will be a set of Rules with precedence and interdependencies (on other policies).

2) A Generic Workflow Engine that will define various workflows with tasks (having triggers, timers)
corresponding to the various strategies. For example some workflows could approximately be like:

FT-WF: Fault Tolerance where a depot failure triggers a workflow engine to execute a certain
predefined workflow of different tasks to be performed. When primary Depot fails, 1. fallback to
secondary which has the most optimal location, 2. initiate state and data migration task,
3. initiate the necessary replication tasks, 4. notify the metadata server about the new depot in
order to updates the exnodes properly.

Rep-WF: Replication that determines the degree and where to replicate. 1. Choose optimal depot
locations for replication 2. Spawn n replication tasks where n=degree

of replication 3. Copy data
between primary and secondary depots

3) Workflows will have tasks that may trigger additional workflows. For example the FT-WF has the
migration and replication tasks that may trigger their corresponding workflows (Rep-WF).

4) Depot Data Store Placement based upon global PDF of the clients as well based upon context (place
a depot in the locality that has the maximal number of clients whose data is stored in it)

Topics for Papers to read: GPFS, CEPH, IBP, IROD, FAST-TCP, CDN, DFS, GridFTP

Symposiums: SAC ‘08
Conferences: InfoScale ‘08
Workshops: UPGRADE ‘08, MIR ‘08

Implementing C Adapter for C++

I am currently in the process of implementing a C-based wrapper/adapter for LStore C++-based CORBA client. I have completed implementing the client-side API and am currently writing a small platform-independent API for managing shared libraries. This will enable C/C++ clients to communicate with the Java LStore metadata server.

Completed CORBA replacement!

I completed the development and testing of the replacement CORBA framework under the L-Store system. I used the Java based JacORB CORBA ORB. Next tasks are:

  1. Merge main dev branch into my branch
  2. Test my branch for correctness
  3. Verify performance of corba
  4. Merge my implementation back into main development
  5. C client api based on corba
  6. Fault tolerance of corba nameservers
  7. Interceptors to replace aspects for security – investigation.

Next Page »